Using the Identity Data Analysis Tool
The Identity Data Analysis web tool is accessible from the RadiantOne Main Control Panel > Wizards tab.
Any user that is a member of the RadiantOne Directory Administrator role, ICS Admin role, or Namespace Admin role can log into the RadiantOne Main Control Panel and access the Identity Data Analysis tool on the Wizards tab. For details on the RadiantOne delegated admin roles, see the RadiantOne System Administration Guide.
Images displayed in this guide are meant to describe expected behavior of features in RadiantOne. Your results may vary from those shown in this guide as data sets are subject to change at any time. The Identity Data Analysis tool is not compatible with Compatibility View in Microsoft Internet Explorer 11.
Working with Datasets
Figure 2.2: The Choose Dataset Type Page
Creating a New Dataset
This option generates and analyzes an LDIF file based on your specifications. Creating a new dataset is the default option on this page. This option allows you to select a point of analysis within the RadiantOne namespace.
You can mount virtual views from each of your data sources below a global root naming context in the RadiantOne namespace and point the Data Analysis tool to this location to perform a single analysis/report from all of your sources at once. This helps you detect attribute uniqueness and statistics across heterogeneous data sources.
There are two default LDAP filters that can be used for creating a new data set – one for identities and one for groups – and allows you to provide an export location and file name for the LDIF that the Data Analysis tool generates.
The RadiantOne service must be running to create a new dataset.
To create a new dataset:
- Click the Create New Dataset option and click Next. The Create New Dataset page displays.
Figure 2.3: The Create New Dataset Page
Select a branch in the Directory Tree in the left pane.
Select Identity or Group depending on the type of object you want to analyze. These but-tons modify the default LDAP filter. Selecting the Identity option sets the default identity LDAP filter to:
- Selecting the Group option sets the default group LDAP filter to:
- If necessary, modify the LDAP filter to match your data. In this example, the LDAP filter is modified as follows.
- Specify an export location. The default export location (based on a default RadiantOne FID installation) is:
- Verify the export file name. The export file name is based on the selected branch in the virtual namespace.
Avoid using invalid characters (< > : " / \ | ? or *) in the file name.
Figure 2.4: The Create New Dataset Option
Wait for the message “Dataset exported successfully”. The time to export the data into an LDIF file varies depending on the number of entries in the naming context being export-ed.
Figure 2.5: Exporting the Dataset
- Click Run Analysis. The data analysis process time varies depending on the size of the LDIF file.
If you click the Run Analysis button to analyze an LDIF that has already been created without moving or renaming the output .csv and .xls files, they are overwritten.
Using an Existing Dataset
If an LDIF has already been generated, you can use the Data Analysis tool to analyze it.
To analyze an existing dataset:
In the Data Analysis tool, click the Use Existing Dataset option and click Next.
Click the Browse button next to the LDIF File Path field, and navigate to the pathname of the LDIF to be analyzed.
Figure 2.6: Selecting an LDIF for Analysis
Click Run Analysis. The Identity Data Analysis Tool displays the Summary tab.
Data Analysis Results
When data analysis is complete, four tabs are displayed at the top of the Data Analysis window. The Summary tab is displayed by default.
Figure 2.7: Data Analysis Tabs
The four Data Analysis tabs are described in the following sections.
The Summary tab compiles the results of the analysis and displays the total number of entries that matched the parameters in the analyzed LDIF file. It lists the size (in KB) of the largest entry and average entry size. The twenty biggest entries are displayed. To sort a column in ascending or descending order, click a column header.
Understanding entry size can help in developing a strategy for sizing memory and disk space for HDAP storage, including caching.
Figure 2.8: The Data Analysis Tool’s Summary Tab
The Run New Analysis button restarts the analysis process and returns you to the Choose Dataset Type.
Re-starting the analysis process over discards your current analysis re-sults.
To export your data analysis to PDF, click the Export to PDF button. The Export to PDF button generates a PDF report of the entire analysis, which it displays in a PDF web viewer in a new browser tab. You may then download and save the generated PDF file.
The Attributes tab aggregates and displays statistics for every attribute of the entries analyzed by the Data Analysis tool. The analysis of each attribute is divided into two groups: Entry Statistics and Value Statistics. To display entry and value statistics for a different attribute, select the attribute from the column on the left side of the window.
Review the Entry Statistics and Value Statistics pie charts (located below the biggest and smallest counts sections). These charts display the counts for the analysis of the selected attribute. In this example, the CITY attribute is selected.
Figure 2.9: Attributes Tab
Figure 2.10: Entry Statistics for the City Attribute
Values in the Total column indicate the number of entries in the analyzed data set. This value is the same for all the attributes (11 in this case, as seen above). This means there are 11 entries containing these attributes.
Values in the Value column indicate the number of entries which contain some value for the analyzed attribute. In the example used for this section, the attribute CITY has a value of 9, which implies that out of the 11 entries in the database data source, 9 have a value for the CITY attribute.
Values in the No Value column indicate the number of entries which contain no value for the analyzed attribute. This column is the opposite of the “Value” column. So for the CITY attribute, the value for the No Value column is 2, implying that two identities do not have a value for the CITY attribute.
Values in the Single Value column indicate the number of entries which contain only one value for the analyzed attribute.
Values in the Multi Values column indicate the number of entries which contain more than one value for the analyzed attribute. For example, let’s say a single identity (uid=Aggie Newcombe) has 2 title values, one is “Guru Inside Sales Manager” and another is “Account Manager” (shown below). In this case, the value for Multi Values for the Title attribute would be 1 indicating one entry has multiple values for the Title attribute.
Figure 2.11: Two Values the ‘Title’ Attribute for uid=Aggie_Newcombe
If entries have multiple values for the analyzed attribute, then the Max Multi Value column indicates the maximum number of values. In the image above, one entry associated with the Title attribute has two values for Title. So, the counter for the Max Multi Value column is 2. Similarly, if the source contained an identity with 3 values for the Title attribute and another identity contained four values for its Title attribute, then the Max Multiple Value column would have a value of four.
If entries have multiple values for the analyzed attribute, then the Average Multi Value indicates the mean quantity of values. This value is derived by dividing the total count of multivalues by the number of entries containing a multi-value, rounded to the closest integer.
Figure 2.12: Value Statistics Pie Chart
Values in the Total column indicate the number of attribute values among all entries. An entry that does not have values for the attribute does not contribute any amount for the value analysis; an entry that has one value contributes one value for the value analysis and so on. The image above shows that the attribute CITY has a count of 9 for the Values column. This implies that this attribute has 9 entries which are used for the value analysis.
Values in the Distinct Values column indicate the number of distinct (different) values in the analyzed attributes. For example, based on the database object analyzed, the count for number of distinct values for the attribute CITY is 5. A table with FIRSTNAME and CITY values for our database would look something like the following.
Figure 2. 13: Table with “firstname” and “city” Values
Values in the Unique Values column indicate the number of values that occur only once in the attribute values. From the table above, the number of unique values of CITY for our database source is 3 (Kirkland, Redmond, and Tacoma) since these values occur only once each in the database source.
Distinct values =
<Unique Values> + <Duplicate Values>.
Values in the Duplicate Values column indicate the number of values that occur more than once in the database source. To continue with the example above, this value would be 2 for the CITY attribute - London and Seattle.
Values in the Blank Values column indicate the number of blank (empty) values for the analyzed attribute. Before analysis, the value is trimmed (spaces deleted at the beginning and end of the value). The result for blank values in the analysis used in this section is 0, which means that no entries had blank values for the attributes analyzed.
Below the pie chart, click the button to the right of Distinct Values Biggest/Smallest Counts.
Figure 2.14: Opening the Distinct Values Biggest/Smallest Counts Table
The Distinct Values Biggest/Smallest Counts table displays.
Figure 2. 15: The Distinct Values Biggest/Smallest Counts Table for the City Attribute
Review the Biggest Counts section (located below the Entry and Value statistics). This section lists the different values for the CITY attribute starting with the most-used value. A similar section named “Smallest Counts” lists the values for the attribute CITY starting with the least-used value.
Below the Distinct Values Biggest/Smallest Counts section, click the button to the right of Entries with the most values in
This section displays for multi-value attributes only.
Figure 2. 16: Opening the Entries with Most Values Table
The values in the Count column in this table indicate the number of values found for the analyzed entry. In the example below, the entry cn=Aggie Newcombe has six values for the objectclass attribute.
Figure 2. 17: Entries with Most Multi-values Table
Correlation Candidates Tab
The Identity Data Analysis tool helps you determine which attributes would be the best candidates for correlation rules. The best attributes to base correlation logic on are ones that are not empty and have unique values for all entries.
For example, if, after analysis, the report indicates an attribute named “EmployeeID” has values for only half the user population in your backend data source, this might not be the best attribute to use in correlation rules. Or if the analysis report indicates that the same “EmployeeID” value is used for more than one entry, this would also mean that it is not the best attribute to base correlation rules on (unless of course the entries with the same “EmployeeID” value do in fact represent the same person, meaning the identity has more than one entry in the same data source).
Once you’ve determined the best attributes for correlation rules, the Global Identity Builder can be used to build a unique view of overlapping identities. Refer to the RadiantOne Global Identity Builder Guide for details.
Figure 2. 18: Possible Candidate for Correlation
Multi-valued Attributes Tab
The Multi-valued Attributes tab shows maximum multiple values and average multiple values by attribute. It also shows which groups have the highest number of values by attribute. This can be useful, for example, to examine the number of members (based on the member or, uniquemember attributes).
Figure 2. 19: The Multi-valued Attributes Tab
To display data for a multi valued attribute, click an attribute in the Most Multiple Values table on the left. The
<ATTRIBUTE> Multiple Values table on the right populates. In the example below, the MEMBER attribute is selected and the table on the right shows a list of groups and the number of values in the MEMBER attribute (meaning number of members) for each. For example, you can see that there is 24 members in the CN=GLOBAL,OU=VIRTUAL GROUPS,OU=ALLPROFILES group.
Figure 2.20: The Member Multiple Values Table