Rapid
 Interactive
  Programming
   Environment

Display Filters

When Dup Finder scans folders/files it stores various bits of information in the current database. In principle there are two sets of information that can be extracted from the database and displayed.

  • The names of the path of the scanned folders.
  • The names of the path and the filename of the scanned files.

You can request that a subset of such data is displayed in the appropriate Dup Finder panel.


There are two types of filter that can be used to select paths, and files, for display.
  • One filter works only on the path, or file, part of the entry and uses a simple and or type logic. (Blue and brown fields).
  • The second type of filter is written in SQLite syntax and can work on any part of the relevant internal database.  (Red and green fields).

These two filter types can be combined.


The blue and brown fields fields accept input in the form of:

  • case insensitive text stings
  • leading and trailing spaces are discarded
  • strings are delimited by spaces
  • a text string with embedded space(s) must be enclosed with inverted commas “”


Note: the blue and brown fields are ignored unless the appropriate check box is “ticked”.


The following examples require that the given text string must be found.

   QUEEn

  “queen”


Note: if the appropriate check box is “ticked” then the program checks your input as you type it in character by character. If the input line has a syntax error then the line has a red background, as soon as the input is valid the background returns to white.


The following examples require that the given text strings must be found, the order is irrelevant

   QUEEn and Stone

   stone And “queen”


You can use and or not and brackets and so create relatively complex filters.

   c:\  and queen and not (stone or age)


If you want to see what the resulting SQLite query is, then activate the menu Help / Show Queries


Note: if you specify a valid and ticked path filter, and then press the button Get Paths then the folder part of the database will be scanned for matches. The Get Paths action ignores any file filter setting.

But: the Get Files button will apply the file filter criteria and the path criteria to the file part of the database (the file part has a filename field and a path name field.

Yes, the internal path name field is “sort of” redundant but is simplifies some internal actions!


The red and green lets you define a filter that can use any field of the relevant database table. But you must express the query in valid SQlite syntax!

For example the folder part of the database has the following fields:

  • id (integer)
    • an index within the table
  • Did (integer)
    • a index in to the Device Table (holds the identity of the storage device on which the folder is kept)
  • Path (text)
    • the name of the path. If the storage device is offline, then the path name starts with a *\: if the device is online (e.g. disk F) then the path name starts with f:\
  • DupFlag (integer)
    • a 3 state flag to indicate wther the folder has only unique files, partially duplicate files, or full unique files
  • LastMod (text)
    • the date and time at which the folder was last modified (this is derived when the folder is scanned, since then the folder might have changed).

So, a query to only show folder entries with a id less than 3, and a path with the text age and a last modified date in 2014 would be:

 


Note: you can combine the SQL filters with the simpler path and file filters.


The structure of a file table in the database is:

  • id (integer)
    • an index within the table 
  • Did (integer)
    • a index in to the Device Table (holds the identity of the storage device on which the folder is kept)
  • Pid (integer)
    • a index in to the Path Table (holds the identity of the path to which this file belongs)
  • Name (text)
    • Only used during certain internal operators, otherwise is empty!
  • File (text)
    • File name and extension
  • Path (text)
    • the name of the path belonging to the file. If the storage device is offline, then the path name starts with a *\:  if the device is online (e.g. disk F) then the path name starts with f:\. (Yes it is technically redundant due to the Pid).
  • Hash (text)
    • The MD5 hash checksum of the file
  • DupFlag (integer)
    • a 2 state flag to indicate whether the file is unique or not
  • LastMod (text)
    • the date and time at which the file was last modified (this is derived when the file is scanned, since then the file might have changed).
  • Size (integer)
    • The file size in bytes

So, a query to only show file entries with a size less than 13, and a File with the text QR would be:


 

There are a set of option buttons to simplify the selection of folders or files where the duplication status is relevant.

Upper line options are only for folders.               --->
                               --->
Lower line options are only for files

Note how a folder (path) can have one of three states:

  • Yes = all files directly under the folders path are duplicated
  • Mix  = some but not all of the files directly under the folders path are duplicated
  • No   = none of the files directly under the folders path are duplicated

A file can have one of two states:

  • Yes = the file is a duplicate (same MD5 hash checksum) as one or more other files in the database
  • No   = the file has a unique MD5 hash checksum


Note: you can select multiple duplicate states, so the following would include only folders that are either fully duplicated, or absolutely unique.


Note: you can combine duplicate filters with the SQL filters and with the simpler path and file filters (even all 3 filters if you wanted!)


Warning: the duplicate status of a folder or file is only valid if you have expressly asked Dup Finder to compare the database with something!

Please refer to Finding Duplicates


Hint:

The entries on the display are presented in order of increasing index (id column) from the respective database table.

If you want the entries to be sorted based on another field, then simply click on the appropriate column header. If the display is already sorted on that column then the display order will be reversed!

[Home] [Uses] [History] [Goals] [First Steps] [Displaying Entries] [Display Filters] [Scan Filters] [Import Export] [Finding Duplicates] [Removable Storage] [Maintenance] [FAQ]