Can SystemLink Server Index Files Stored in S3?

Updated Jan 7, 2025

Reported In

Software

  • SystemLink Server
  • SystemLink TDM DataFinder Module

Issue Details

  • I have configured my SystemLink Server installation to use Amazon S3 as the file storage. Can I configure a DataFinder Instance to index these files?
  • Is it possible to index files stored in a S3 bucket?

Solution

SystemLink DataFinder Instances cannot index S3 directly. Instead, it is necessary to configure a DataFinder Instance that indexes the SystemLink File Service, which points to S3.

 

When configuring S3 as the file storage, the process is as follows:

 

  1. The SystemLink File Ingestion Service points to S3. See Uploading Files to Amazon Simple Storage Service (S3) for configuration instructions.
  2. A DataFinder Instance can be configured to index the SystemLink File Service. See Creating a DataFinder Instance for instructions.
  3. When a file is processed, it is indexed before it is moved to S3. The index data is stored in a MariaDB backend database.
    • The path to the index data can be found in the NI SystemLink TDM Configuration application on the Index/Cache Settings tab as shown below.

 

SL TDm Configuration.PNG