Filter
From Clariopedia
Contents |
Overview
The clario® node Filter allows you to select rows from an input data stream based on specific selection criterion/criteria.
Usage
Input Stream
The node connector can be connected to a variety of nodes, (ie. Read, Aggregate, Append, Missing, etc.), but requires a valid stream of data.
Configuration
The Filter node has only one configuration face.
Configuration Face
Filter Builder
The upper-right box contains the scoring ‘pseudo code.’ This code cannot be directly edited but, can be copied and pasted for reference or, for use in creating code in other coding environments. You can also use this ‘pseudo code’ to check your expression for accuracy.
The far left box contains: Attribute quick search – To efficiently find attribute names, begin typing an attribute name in the text box directly above the attribute list. You will be directed to the attributes beginning with the letter(s) you type.
The bottom right portion of the filter builder window contains the coding tools to perform a variety of functions that are offered in the Filter node. These functions include:
| Function | Description |
| Abs | Compute the absolute value of an attribute |
| addDays | Return a date with a specified # of days added to the date |
| Ceiling | Convert a real # up to the next highest integer ex. 4.2 becomes 5 |
| Condition | Create a conditional (if, then, else) |
| concat | Concatenate more than one attribute into one attribute |
| Cos | Compute the Cosine of the attribute |
| DayOfMonth | Parse the day from a date variable |
| Exp | Compute the exponential function exp(x) of an attribute |
| Floor | Convert a real number up to the next lowest integer ex. 4.2 becomes 4 |
| Length | Specify the length of an outgoing attribute |
| Log | Compute the logarithm of the attribute |
| MonthOfYear | Parse the month from a date variable |
| Paren | Insert open or close parentheses in an equation/function |
| Pow | Raise an attribute to the nth power |
| quarterofYear | Return a value 1-4 for the quarter of the year in which a date falls |
| Random | Create a random number attribute |
| Sin | Compute the Sine of the attribute |
| Sqrt | Compute the square root of the attribute |
| Substring | Select a portion of a a string variable |
| Tan | Compute the Tangent of the attribute |
| toLowerCase | Convert attribute to all lower case |
| toUpperCase | Convert attribute to all upper case |
| trim | Trim leading and trailing spaces from an attribute |
| WeekOfYear | Return a value 1-52 for the week of the year in which a date falls |
| YearOfDate | Parse the year from a date variable |
Operators
| + | Add |
| - | Subtract |
| / | Divide |
| * | Multiply |
| == | Equal to |
| != | Not Equal to |
| > | Greater than |
| < | Less than |
| >= | Greater than or Equal to |
| <= | Less than or Equal to |
| && | And |
| ❘❘ | Or |
Constants
String – Create a string constant ex. ‘Y’
Number – Create a numeric constant ex. 1
Date – Create a date constant
Null – Create a null variable ex. Replace 999 with null to calculate a more accurate mean
Field Definitions
- Valid Inputs – You must link to a valid data stream (ie. Read, Append, Filter, etc.)
- Filter cannot be Null
Results
There is no results face for the filter node.
Output Stream
Due to the unique design of clario, where data is streamed throughout all processing, there is no direct data output as a result of executing the filter node. The filter node is designed to filter a dataset for other nodes to explore, manipulate, cleanse, and model the data. The data can be exported at any point in a workflow by using the Write node.
Video Demonstrations
References
None.
