[DG: Teaching & Learning] Question - Anyone Tracking Faculty Activity in Courses?

Wed Apr 1 07:13:22 PDT 2015

Hi Pat,

Yes looking forward to talking with you again at the Open Apereo Conference.

LA at Campus level implies a movement towards data centralism.  Once you have your data governance (student control over their activity data) sorted out and your student activity from various systems mixed in with SIS in a data warehouse you can leverage for a wide range of potential  services which you would not necessarily call Learning analytics, but X Analytics  later (where X = predictive, action, academic etc) .

An example is the JISC infrastructure (http://analytics.jiscinvolve.org/wp/2015/02/13/refining-a-systems-architecture-for-learning-analytics/). Standards such as LTI, xAPI and Caliper (when it is publicly available in May?) and Learning Record Stores sit well in the picture and potentially allow universities a greater degree of interoperability.

In other words, if you use something like an LTI enabled dashboard and a standards based way to collect and query your student activity you can do work now, but also gain experience (and an incrementally improving infrastructure) for an emerging Open Learning Analytics framework later.

Regards,
           Alan

Alan Berg

Innovation working group
On the use of ICT in Education & Research
University of Amsterdam
Postbus 1025 / 1000 BA Amsterdam
Weesperzijde 190 / 1097 DZ Amsterdam
________________________________
From: Pat Miller [pmiller at nd.edu]
Sent: 01 April 2015 14:48
To: Berg, Alan
Cc: Gregory Guthrie; David Eveland; pedagogy at collab.sakaiproject.org
Subject: Re: [DG: Teaching & Learning] Question - Anyone Tracking Faculty Activity in Courses?

Hi, Alan,
It was great chatting with you at LAK15!  I had not thought of these dashboard hackathons as possibly also encompassing or resulting in dashboards on overall tool usage by faculty.   I guess if the flows of data include all the data we currently get in a table query then it should be able to give us this type of report.

As a non-developer with decent experience with various query tools on the administrative side of the university,  I use the tools most easily available on a data format that is easily accessible.  It would be great if Open LRS and Open Analytics could make operational reporting as easy as they seem to be making predictive analytics.  The infrastructure for it is more complex, however;  certainly much more involved than a single table with all the pertinent data pulled from the LMS.

Again, look forward to seeing great discussions/demonstrations at Apereo.

Pat

On Wed, Apr 1, 2015 at 3:23 AM, Berg, Alan <A.M.Berg at uva.nl<mailto:A.M.Berg at uva.nl>> wrote:
H Gregory,

The OpenDashboard is working with the OpenLRS at the Uniformed University.

We (well Unicon) provided a full end to end example with an LRS, fake data, Sakai for a 2 day hackathon at the LAK15 conference. http://lak15.solaresearch.org/zh/hackathon , https://www.surfspace.nl/artikel/1773-day-1--lak15-hackathon--building-an-educational-dashboard/ The hackathon is the second in a series. There are currently incoming inquiries for 6 more events. Patrick Lynch from Hull University is looking at the possibility for the Open Apereo Conference. We are going to keep track here: https://confluence.sakaiproject.org/display/LAI/LAI+Hackathons

Both hackathons encompassed twenty attendee's which was enough for 4 teams. We are looking towards innovating with a scrum like event with a local dev team taking the baton after a hackathon. It would be great to sprint to crystalize local needs into a real product.

Stefan Mol from the University of Amsterdam and Catherine Zhoa from North West University Australia are keeping track of the emerging requirements across hackathons.  The requirements are just as important as the software artefacts and this are getting documented.

We are moving quite fast at the moment. You are most welcome to join in if you want to build openly within the community.

Regards,
           Alan

Alan Berg

Innovation working group
On the use of ICT in Education & Research
University of Amsterdam
Postbus 1025 / 1000 BA Amsterdam
Weesperzijde 190 / 1097 DZ Amsterdam
________________________________
From: Gregory Guthrie [guthrie at mum.edu<mailto:guthrie at mum.edu>]
Sent: 01 April 2015 03:59
To: Berg, Alan; Pat Miller; David Eveland
Cc: pedagogy at collab.sakaiproject.org<mailto:pedagogy at collab.sakaiproject.org>
Subject: RE: [DG: Teaching & Learning] Question - Anyone Tracking Faculty Activity in Courses?

Alan, Thanks – is there an example somewhere of an end-end usage of this for doing site usage and progress monitoring and analysis?

It looks very interesting, but is one part of a full system as I read it.

Similarly, the OpenDashboard from the Apero github site looks interesting, but is there any description or demo of its usage and results?

Best,
Gregory
-------------------------------------------

From: Berg, Alan [mailto:A.M.Berg at uva.nl<mailto:A.M.Berg at uva.nl>]
Sent: Tuesday, March 31, 2015 4:51 PM
To: Gregory Guthrie; Pat Miller; David Eveland
Cc: pedagogy at collab.sakaiproject.org<mailto:pedagogy at collab.sakaiproject.org>
Subject: RE: [DG: Teaching & Learning] Question - Anyone Tracking Faculty Activity in Courses?

For the long run, Sakai is xAPI enabled so you can get the activity streams out to a secure repository without querying the database. There is also some preliminary work on Caliper in the openLRS

https://confluence.sakaiproject.org/display/LAI/Learning+Analytics+Initiative
https://github.com/Apereo-Learning-Analytics-Initiative/SakaiXAPI-Provider

Regards,
           Alan

Alan Berg

Innovation working group
On the use of ICT in Education & Research
University of Amsterdam
Postbus 1025 / 1000 BA Amsterdam
Weesperzijde 190 / 1097 DZ Amsterdam
________________________________
From: pedagogy-bounces at collab.sakaiproject.org<mailto:pedagogy-bounces at collab.sakaiproject.org> [pedagogy-bounces at collab.sakaiproject.org<mailto:pedagogy-bounces at collab.sakaiproject.org>] on behalf of Gregory Guthrie [guthrie at mum.edu<mailto:guthrie at mum.edu>]
Sent: 31 March 2015 23:40
To: Pat Miller; David Eveland
Cc: pedagogy at collab.sakaiproject.org<mailto:pedagogy at collab.sakaiproject.org>
Subject: Re: [DG: Teaching & Learning] Question - Anyone Tracking Faculty Activity in Courses?
Pat,
This sounds interesting – I’d love to get a look at whatever you use, and the reports produced.

We are interested in developing this area, although we have limited resources, we might be able to help with implementations.

If you could PM me?

----------------------------------------------------------
From: pedagogy-bounces at collab.sakaiproject.org<mailto:pedagogy-bounces at collab.sakaiproject.org> [mailto:pedagogy-bounces at collab.sakaiproject.org] On Behalf Of Pat Miller
Sent: Tuesday, March 31, 2015 3:53 PM
To: David Eveland
Cc: pedagogy at collab.sakaiproject.org<mailto:pedagogy at collab.sakaiproject.org>
Subject: Re: [DG: Teaching & Learning] Question - Anyone Tracking Faculty Activity in Courses?

Hi, David,
I just read Gregory's response and he seems to have a nice automated reporting system!

We have been querying a table into which our Sakai hosting partner (Longsight) feeds activity from all sites-- kind of a data mart which was built using SQL scripts originally used to extract the data from Sakai into files.  Now having this table makes it much easier to get the data we need for reports.  We don't have any contractual requirements like you do, but find it helpful to give info to our LMS faculty guidance council so they are aware of who of their colleagues are most active in Sakai.  It helps the LMS team to also see which tools are not being used so we can target training opportunities.  We also use it to find faculty exemplars to present at monthly faculty lunch'n' learns on how they use various Sakai or 3rd party tools.

We use Tableau to query this table to get both student activity and faculty activity.   We can see activity on all Sakai tools and for all course sites.  For LTI tools we can see the launch but, of course, since the actual activity is held by the tool site, we can't see the detailed activity.

We link the ID of the instructors with our Banner system to find out which departments they are from but this currently is not an automated process.  So we take the Tableau data summaries and import into Oracle to then link with Banner and come up with reports by College, department, etc.

I imagine the Sakai queries we are using are probably similar to the ones Gregory is using.  It would be good to find out how they compare!

Any of you going to the Aperio Conference?  I am presenting about what we do to get our reports.  But I was thinking of the session as a good chance to share ideas.

Pat
University of Notre Dame

On Tue, Mar 31, 2015 at 3:50 PM, David Eveland <DEveland at johnsonu.edu<mailto:DEveland at johnsonu.edu>> wrote:
All,
 Sorry if this isn’t the right context for this.
 We’re presently looking to gather some data on the level and kind of involvement our faculty have in their online courses, and are familiar with the Statistics tool in Sakai to gather just this type of information.
 However, we’re also looking at being able to provide a more responsive engagement with faculty – if for example they’re not remaining engaged or active in their online courses (as our contract spells out).  One way to check for this is to use the Statistics tool in every course an instructor is teaching in in the current term, and then relay that information to that faculty member’s respective dean or school.
 Another way would be to have a service that simply looks into the current term’s courses for just this sort of data and notifies those deans accordingly if (say) the instructor hasn’t engaged with a particular course for more than 4 days.
 Any thoughts are helpful.
[cid:image001.png at 01D06BF5.A0C68A30]<http://www.johnsonu.edu/>—
Dave E. | Johnson University
865.251.2320<tel:865.251.2320>
--- End of Message ---

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/pedagogy/attachments/20150401/4243864a/attachment-0001.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 1857 bytes
Desc: image001.png
Url : http://collab.sakaiproject.org/pipermail/pedagogy/attachments/20150401/4243864a/attachment-0001.png 