Using the Engagement Dashboard

The Engagement Dashboard contains visualizations that provide insight into how learners are engaging with their courses. The goal of this dashboard is to help users, primarily instructors and advisers, to identify at-risk learners so that they can intervene and get learners back on track. The information provided in the dashboard allows for individualized improvement suggestions by providing context and a holistic view of the learner. By filtering out irrelevant data and combining metrics by filtering on cards, users can focus on their own definition of an at-risk learner.

Viewing and Interacting with the Engagement Dashboard

The dashboard contains 3 main sections:

  • Filters, which appear as dropdown menus for Org Unit and Semester. If you click a data point in a chart in the Summary View to further filter report content, those filters are also listed in this area.
  • The Summary View includes the Results summary, Discussion Activity pie chart, Overdue Assignments summary, System Access summary, Current Grade bar chart, Time in Content vs. Grade scatterplot, Course Access bar chart, and Content View bar chart.
  • The Results area that contains a dynamic user table of learners who meet the criteria applied to the dashboard. As you add filters to the summary data, the learners listed in the User Table automatically change to reflect the updated Summary view.

Summary information about the dashboard in the upper left quadrant of the dashboard

Figure: The Summary View of the Engagement Dashboard.

By default, the 10 most recently accessed courses within the 3 most recently created semesters appear on the report the first time you load the dashboard. A pop-up appears when you first access the Engagement Dashboard that summarizes what displays in the default view. The Org Unit drop down filter includes a list of all courses in the Org Unit, with the 10 most recently accessed courses within the 3 most recently created semesters selected.

Add or remove initial org unit, semester, and role filters using the dropdown filters.

Figure: Add or remove org unit and semester filters using the dropdown filters.

You can dynamically add or remove courses and other org units such as school, campus, department and so on, by clicking the check box beside the org unit name. You can also limit the dashboard query results to specific semesters (sorted by date) or roles within your organization.

If the auditor permission path is enabled, auditors (users with an existing auditor relationship) will only see user-level data about the learners they audit.

Note: When you filter by All Org Units in an organization, if there is only one org unit in a branch that is not a course offering, that org unit does not appear; only branches with more than one item appear. For example, if an organization has a structure of district, board, school, grade, and course, a user in a specific school does not need access to the structure above the school. The org structure prunes the district, board, and school to reduce the number of times a user clicks to browse to the org structure that is applicable to them.

When you interact with cards or filters, any filters you apply are saved to the URL. You can bookmark views in your browser and return to the same view in the future. If you share the URL with another user, note that their permissions may differ and cause them to see different results with the same link.

Using the Summary View

Summary information about the dashboard in the upper left quadrant of the dashboard.

Figure: Summary information about the dashboard in the upper left quadrant of the dashboard.

The Results block indicates the number of learners represented by the charts in the dashboard. This is the number of learners that appears in the user table in the Results section at the bottom of the dashboard.

The Discussion Activity pie chart indicates the number of discussions created, replied to, and read. If you hover over a pie segment, a pop-up appears with a number and description of the segment. This is helpful for understanding the proportion of passive and active social engagement. If you click a segment, the rest of the Engagement dashboard automatically filters the returned data for the learners represented by the segment. This is also summarized in the results table.

The Overdue Assignments card displays the number of learners meeting the filters applied to the dashboard who have one or more overdue assignments. If you apply filters to the dashboard content, this number automatically changes to reflect the learners reflected by the updated data.

Note: Group assignments are not included in the Overdue Assignments metrics.

The System Access card indicates the number of learners who have not accessed the system in the previous 14 days. Access is counted whether the learner is using the Brightspace Pulse app or Brightspace Learning Environment in a browser. This is also summarized in the results table.

Using the Current Grade bar chart

Chart of the number of users who have achieved grades, displayed in 10th percentile groupings.

Figure: Chart of the number of learners who have achieved grades, displayed in 10th percentile groupings.

If you click one or more bars, the dashboard filters the returned data for learners and courses where the learner has a grade in the selected range. For example, the following image shows the dashboard filtered to include only learners who have less than 60% in a course:

The Grade chart dynamically changes to reflect the applied filter. The Summary information also changes to reflect the filtered data

Figure: The Current Grade chart dynamically changes to reflect the applied filter. The Summary information also changes to reflect the filtered data.

Using the Time in Content vs. Grade scatterplot

The chart plots users’ grades against the amount of time they spend in the course

Figure: The chart plots learners’ grades against the amount of time they spend in the content.

If you click a quadrant, the dashboard filters on the learners and their courses in that quadrant.

  • Data points in the top left quadrant plot learners that have an above average grade and spend below average time in the content.
  • Data points in the top right quadrant plot learners that have an above average grade and spend above average time in the content.
  • Data points in the lower left quadrant plot learners that have a below average grade and spend below average time in the content.
  • Data points in the lower right quadrant plot learners that have a below average grade and spend above average time in the content.

To view the details for the quadrant, hover over the quadrant:

When you hover over a quadrant, information about the number of users in the quadrant appears in a popup

Figure: When you hover over a quadrant, information about the number of learners in the quadrant appears in a popup

When you apply filters to the report, the scatterplot also changes to reflect the new query results. For example, if you apply the filter for learners who have less than 60% in a course that we used earlier, the scatterplot also dynamically changes to represent that filter.

The Time in Content vs Grade scatterplot dynamically changes to reflect the applied filter

Figure: The Time in Content vs Grade scatterplot dynamically changes to reflect the applied filter. The Summary information also changes to reflect the filtered data, as in the same example above.

Using the Course Access chart

The Course Access bar chart indicates the number of days since learners last accessed the course.

If you hover over one of the Course Access bars, a popup appears with detailed information about the bar

Figure: If you hover over one of the Course Access bars, a pop-up appears with detailed information about the bar.

If you click one or more bars, the dashboard filters the returned data for the learners and courses where the learner has accessed a course in that time range.

Note: Depending on the filters you applied, a learner could be counted in more than one date range, and/or more than once in a single date range if they are enrolled in multiple courses.

You can use more than one filter on the Engagement Dashboard to display more precise, relevant information. For example, if you apply the filter for learners who have less than 60% in the course that you previously used, you might also apply a filter on the Course Access bar graph to further refine the dashboard results to learners who have never accessed the course:

Laying additional filters results in updates to the other charts on the dashboard to reflect the filtered data

Figure: Laying additional filters results in updates to the other charts on the dashboard to reflect the filtered data, as in the examples above.

Using the Content View chart

The Content View bar chart aggregates the number of times learners looked at course content.

Content View chart shows how many times learners have visited course content

Figure: The Content View chart shows how many times learners visited course content.

It allows you to review how many times items in the course content tool, such as images, PDFs, or Word files, have been viewed to better understand content viewed offline or that was downloaded.

If you click one or more bars, the dashboard filters the returned data for the learners and courses where the learner visited a course the specified number of times.

Using the table in the Results section

The default view of the user list table contains all the users reflected in the dashboard query results. When you change the courses displayed on the dashboard or apply filters, the users that appear in the table also change to display those reflected in the new query results.

For each user, the following information is included in the table:

  • First and last name, username and Userid
  • Number of the user’s courses reflected in the query results
  • Average grade across the user's courses reflected in the query results
  • Average time in the content for the courses reflected in the query results
  • Average discussion activity for threads created, threads read, and replies for the courses reflected in the query results.
  • The last time the learner accessed the system.

Note: If there is a predicted grade for the learner, it appears for all users who can see the dashboard.

At the bottom of the list, there is a total number of users:

The Total Users number is also reflected in the Summary information.

Figure: The Total Users number is also reflected in the Summary information.

You can click a user in the results table to see their Learner Engagement Dashboard, and learn more about engagement across their courses without aggregating the data from other learners. Any filters you apply to the Engagement Dashboard will persist when you navigate to the Learner Engagement Dashboard.

Exporting user query results

Users can export the query results so that they can combine the results with other data or perform other analytics on the content.

The Email and Export to CSV buttons underthe User Details section

Figure: The Export to CSV button on the Engagement Dashboard.

Advisers can email one or more learners directly from the Results section of the Engagement Dashboard, or email a single learner from their Learner Engagement Dashboard.

Figure: The Email button under the Results section of the Engagement Dashboard.

To email learners or export the report query results

  1. Apply the filters you want to use to the cards at the top of the dashboard.
  2. Do one of the following:
    • Click Email and complete the email dialog to email selected users.
      Note: the See External Email Addresses for <role>, and either Send Emails to External Email Addresses or Send Emails to Internal Email Addresses permissions are required, depending on the type of email type you intend to send
    • Click Export to CSV and indicate the export destination location.

Configuring the Engagement Dashboard display using Settings

The Engagement Dashboard Settings page enables you to select which metrics display in the Engagement Dashboard. The Settings page is available on the More Actions menu.

The More Actions menu on the top right of the dashboard interface contains the Settings option

Figure: The More Actions menu on the top right of the dashboard interface contains the Settings option.

The Settings page has three tabs: Summary Metrics, Result Table Metrics, and User Level Metrics. The Summary Metrics tab contains the Roles filter, which enables you to select the learner roles you want to include in dashboard data. All roles that you exclude are not included in any data query on the Engagement Dashboard.

The Roles filter section of the Summary Metrics tab displays a list of all learner roles in your organization; your list may appear differently depending on the roles you are using.

Figure: The Roles filter section of the Summary Metrics tab displays a list of all learner roles in your organization; your list may appear differently depending on the roles you are using.

 

The Summary Metrics tab also enables you to determine which cards are included in the Dashboard display and set your own threshold for the System Access metric. By default, all the cards are included on the dashboard.

All cards appear in the selection list, and all are selected by default.

Figure: All cards appear in the selection list, and all are selected by default.

 

The Results Table Metrics tab enables you to set the metrics that display in the Result Detail sections of the dashboard, including Average Grade, Average Time in Content, Average Discussion Participation, and Last System Access. Your selections here also determine which columns display under Active Courses and Inactive Courses in the Learner Engagement Dashboard.

All the Result Table Metrics are selected by default.

Figure: All the Result Table Metrics are selected by default.

 

The User Level Metrics tab enables you to set the metrics that display in the Learner Engagement Dashboard.