Solution
To monitor memory usage on your NI Linux Real-Time Target, you can use the
System Exec VI to run commands in the Linux shell. The command
cat /proc/$(pidof lvrt)/status | grep RSS returns the Resident Set Size of the LabVIEW process (Resident Set Size gives the amount of memory allocated to a process).
Note: This does not report total memory usage of the entire OS, which has its own memory consuming processes. This method of memory monitoring is primarily useful for detecting memory leaks.
You can try this by setting up a LabVIEW project with your NI Linux Real-Time OS device and creating a VI that resembles the block diagram below.