Skip to main content

Configure Java VFS Service

The Java VFS Service is the next generation service for the virtual file system for the Designer Cloud Powered by Trifacta platform. This service is required for the following integrations:

  • S3 Connections

  • SFTP Connections

  • ADLS Gen1

  • ADLS Gen2

  • WASB

In future releases, it may be applied to other components of the platform, instead of VFS Service. For more information on the earlier version, see Configure VFS Service.

Configure

  1. You can apply this change through the Admin Settings Page (recommended) or trifacta-conf.json. For more information, see Platform Configuration Methods.

  2. Locate the following configuration:

    "java-vfs-service.enabled":true,
"java-vfs-service.host":127.0.0.1,
"java-vfs-service.port":41917,

    Parameter

    Description

    enabled

    Set this value to true to enable the Java VFS Service.

    host

    Host of the Java VFS Service. This host is used to listen to requests from the Trifacta Application. Leave this value as 127.0.0.1.

    port

    Port number that Java VFS Service uses to communicate. This port number is used to listen to requests from theTrifacta Application. Default value is 41917.

    This port must be opened on the Trifacta node. See System Ports.

  3. Verify that the enabled parameter is set to true.

  4. Locate the following properties. These properties define the address and port used by other services in the Designer Cloud Powered by Trifacta platform to communicate with the Java VFS Service:

    Note

    These property values can differ with the host and port values specified above.

    "java-vfs-service.systemProperties.server.host": 127.0.0.1,
"java-vfs-service.systemProperties.server.port": 41917,

    Parameter

    Description

    host

    Internal address of the Java VFS Service. This host is used to listen to requests from other platform services. Leave this value as 127.0.0.1.

    port

    Port number that Java VFS Service uses to communicate with other platform services. Default value is 41917.

  5. Save your changes and restart the platform.

Additional Configuration

Change memory for Java VFS service

In some cases, you may notice errors like the following in the Java VFS service logs:

java.lang.OutOfMemoryError: Java heap space

In this case, the service is running out of allocated memory. As needed, you can expand the memory allocated to the service:

Steps:

  1. You can apply this change through the Admin Settings Page (recommended) or trifacta-conf.json. For more information, see Platform Configuration Methods.

  2. Locate the following parameter, which is set to 512 MB by default:

    "java-vfs-service.jvmOptions": "-Xmx512m",

  3. You can experiment with raising this value to 1024 MB (-Xmx1024m).

  4. Save your changes and restart the platform.

Whitelist file storage protocols

When interacting with file storage systems, the Java VFS service checks the filestorage whitelist to verify that a particular file system is permitted. As needed, you can add other filesystem protocols to this list.

For more information on the values to insert here:

Steps:

  1. You can apply this change through the Admin Settings Page (recommended) or trifacta-conf.json. For more information, see Platform Configuration Methods.

  2. Locate the following parameter, which is set to 512 MB by default:

    "filestorage.whitelist": "sftp,s3",

  3. For each file system, you can configure the starting location for that system's protocol. In the following the root directory (/) is the starting directory for SFTP and S3 systems:

    "fileStorage.defaultBaseUris": "sftp:///,s3:///",

  4. Save your changes and restart the platform.

Logging

You can configure how logging is managed for the VFS service. For more information on configuring logging for the VFS service, see Configure Logging for Services.

In this section: