Create Academic Analytic Tools
The Ribbon tool is a visualization system used to understand the pathways that students take between majors or disciplinary clusters. It aggregates student data based on user-defined categories and shows the population flows between these categories over user-defined spans of time. Understanding the factors that cause major migration can inform research into universities’ retention practices.
Generalized Observation and Reflection Platform (GORP)
The GORP tool offers a solution to the challenge of measuring the extent to which faculty members are engaging in active learning techniques, which a growing body of evidence indicates benefit student learning. Building on the COPUS (Classroom Observation Protocol for Undergraduate STEM) instrument developed the Carl Wieman Science Education Initiative at the University of British Columbia to characterize university STEM classroom practices, GORP is a web-based system for carrying out classroom observations using user-defined protocols and analyzing the data collected during observations. The tool allows observers to record data using a simple, mobile-friendly fully customizable interface.
Research shows that certain students are less likely to be called on in class than others – for example, students who don’t volunteer to be called on; students with names the instructor cannot pronounce; students who are reticent – and that the likelihood of being called on is a motivation for being prepared.
The Cold Caller app provides a simple interface for instructors to randomly select students from a list for the purpose of asking on the spot questions or “cold-calling”. It allows the teacher to record whether the student was in attendance, whether students answered the questions, and if their answers were correct. It also allows the instructor to take free form notes about each cold-call.
For any organization that offers services or hosts events, it is important to see who you are serving and how. This is particularly important in educational settings, where attendance at trainings, workshops, and other events are essential to the learning process. Though many tools exist for tracking event attendance, none met the specific needs of CEE and the units we support.
The Event Tracker allows users to create events and check people into events by using a student or employee ID card and inexpensive card swiping hardware, and simplifies exporting the raw data and other reports about event attendance. It also allows users to create and automatically export certificates of achievement which specifically require one or more events or event categories. It is currently in use by several UE units.
- HEAT Map
- Course Difficulty
- Course Requisite Premapper
- Inter-rater Reliability (IRR) Tool: The IRR tool provides the ability for researchers to have an automated way of calculating inter rater reliability for any dataset that deals with behavioral coding. The tool is able to apply the appropriate IRR technique based on number of raters in the dataset. It outputs a convenient table with appropriate IRR statistics. Our hope is that this tool will be used by researchers who undertake any type of behavioral coding in a classroom setting. This tool is currently being integrated into our GORP tool, and a standalone tool is in development.