This content is not available in your preferred language.

The content is shown in another available language. Your browser may include features that can help translate the text.

Can SystemLink Server Index Files Stored in S3?

Updated Jan 7, 2025

Reported In

Software

  • SystemLink Server
  • SystemLink TDM DataFinder Module

Issue Details

  • I have configured my SystemLink Server installation to use Amazon S3 as the file storage. Can I configure a DataFinder Instance to index these files?
  • Is it possible to index files stored in a S3 bucket?

Solution

SystemLink DataFinder Instances cannot index S3 directly. Instead, it is necessary to configure a DataFinder Instance that indexes the SystemLink File Service, which points to S3.

 

When configuring S3 as the file storage, the process is as follows:

 

  1. The SystemLink File Ingestion Service points to S3. See Uploading Files to Amazon Simple Storage Service (S3) for configuration instructions.
  2. A DataFinder Instance can be configured to index the SystemLink File Service. See Creating a DataFinder Instance for instructions.
  3. When a file is processed, it is indexed before it is moved to S3. The index data is stored in a MariaDB backend database.
    • The path to the index data can be found in the NI SystemLink TDM Configuration application on the Index/Cache Settings tab as shown below.

 

SL TDm Configuration.PNG