Difference between revisions of "Teacher Reporting"
Jrgreen118 (talk | contribs) |
Wwdillingham (talk | contribs) |
||
| Line 1: | Line 1: | ||
{{TOCright}} | {{TOCright}} | ||
==Description== | ==Description== | ||
| + | |||
| + | To help in contribution of this project, please visit us at our [Git http://git.sugarlabs.org/projects/teacher-reporting] | ||
| + | |||
A custom [http://moodle.org/ Moodle] [http://docs.moodle.org/en/Quiz_module quiz module] which, in addition to the standard Moodle quiz features, analyzes the questions posed to the student for various qualities, such as compliance with [[User:Gdk/4th_Grade_Maths | Curriculum Standards]]. | A custom [http://moodle.org/ Moodle] [http://docs.moodle.org/en/Quiz_module quiz module] which, in addition to the standard Moodle quiz features, analyzes the questions posed to the student for various qualities, such as compliance with [[User:Gdk/4th_Grade_Maths | Curriculum Standards]]. | ||
Revision as of 16:53, 10 June 2009
Description
To help in contribution of this project, please visit us at our [Git http://git.sugarlabs.org/projects/teacher-reporting]
A custom Moodle quiz module which, in addition to the standard Moodle quiz features, analyzes the questions posed to the student for various qualities, such as compliance with Curriculum Standards.
The modified Moodle modules will run on a customized XS School Server operating system. Our goal is to allow results and / or grades, from student activities to be readily available to teachers. Based on their wants and needs, the teachers can then generate custom reports on a class or student and have the ability to determine what types of problems students are finding most difficult. In the end we imagine the XS environment running on an XO itself, allowing the teachers the same portability as the students.
Group Members
- Project Manager: Wesley Dillingham
- Additional Group Members: Jeremiah Green
Data Flow Diagram
Goals
- Expand upon the PHP of the Moodle Quiz Module to parse questions involving mathematical operations for characteristics contained in the Massachusetts Curriculum Framework for Mathematics.
- Parse mathematical-operation-based and tally percentage of success with each individual operation (+,-,/,* etc).
- Run Moodle with the modified quiz module on an XO running XS, The XO school Server.
- Create Moodle data flow diagram to give an understanding of how the Moodle Server and corresponding database interact with Student and Teachers machines.
- Have Moodle's latest stable release functioning in an XS School Server VirtualBox OSE Virtual Machine
- Have Moodle's latest stable release functioning on an XO running XS using the techniques outlined here.
- Have PHP calls successfully querying mock student results from Moodle's MySQL database running on XS.
"How to Play/Use" for end user
Our project is not intended for a direct use by students. Components (not yet developed) under the scope of our project exist on students computer's in so far as facilitating the data movement from the XO to the XS. Therefore, there are no directions for students on how to use our application, it will be entirely transparent to them. When a student begins an activity which is compatible with our application, it will automatically report information to the API. Our application will then read this information from the API and produce reports to the teacher. We envision this interface to be web based, allowing the teacher to select particular games, and as a subcategory, the particular curriculum requirements in which that game uses.
At this moment (5/18/2009) we only have a script which analyzes performance on particular mathematical operations and the students ability to understand order of operations.
In order to run this script (parser.awk) issue the command,
awk -f parser.awk students.dat
Teachers guide
Student.dat file fields:
MAC-ADDRESS STUDENT_NAME OPERATION CORRECT
Example:
0C7B6G0023BC Wesley 9/3+7 1 0C7B6G04DBBA Jeremiah 4+10/7 0 0C7B6GBA5D7D Billy 88-28*2 0 0C7B6G07E9HB Bob 4*5 1
Ouput Example:
Student Only + Contains + Only - Contains - Only * Contains * Only / Contains / Understands OoO? wes 25 28 12 100 80 83 71 53 no bob 80 77 0 66 100 100 33 60 yes jeremiah 0 0 16 33 40 50 14 33 no billy 66 70 33 53 50 37 100 80 yes
note: This output is not reflective of the student.dat example data above
XS SchoolServer on the XO
A major barrier to achieving our goals is the idea that the School Server needs the ability to be versatile and portable. While some may have resources to dedicate substantial hardware to such a server, others may find themselves with nothing more than the XO laptops. From this stems the idea of running this server on one of the XO laptops via either a USB flash drive, SD card, or the internal NAND hard drive.
When fully installed on an SD card, the base operating system takes up about 1.6GB. There is a small amount of documentation available which is excellent and extremely helpful, but it can be difficult to use at times. Below is a quick break down of what we did and how to replicate it.
How To:
The most helpful website to read before beginning can be found here: Laptop.org's XS-on-XO.
Necessary hardware to replicate our setup includes:
- XO Laptop
- Linux Computer with SD Card Reader
- Can be physical machine or virtual. Also, some things can be done in Windows.
- SD card which is at least 4GB (We used an 8GB A-DATA SDHC)
Un-compress the image:
- Download the image file: OLPC-School-Server-0.5.2-dev01-i386.img.gz
- Un-compress the file
- In Windows, WinRAR worked well.
- In Linux, this command works just as well
gzip -d OLPC-School-Server-0.5.2-dev01-i386.img.gz
Setting Up the Environment
With the SD card connected to the Linux PC:
- Using a tool of your choice format the SD card to ext2 or ext3 (Linux 83).
- Gparted was excellent for formating the SD card to ext3, but fdisk would also work.
- Mark the partition with the boot flag
- This can be done using gparted, but in several instances errors were experienced. In lieu fdisk works great.
- To enter fdisk, use
fdisk /dev/sd*1 or fdisk /dev/mmcblk*p1
- where * is the letter associated with the SD device and the 1 is the partition. Once in fdisk, use the help to determine the specific command to mark the boot flag. In most instances it will be "a".
- Next ensure the .img file, uncompressed previously, is accessible by the Linux machines.
- Use the command,
dd if=OLPC-School-Server-0.5.2-dev01-i386.img of=/dev/sd*1 or dd if=OLPC-School-Server-0.5.2-dev01-i386.img of=/dev/mmcblk*p1
- This will take some time depending on the system performance.
- Use resize2fs to re-size the partition
resize2fs -p /dev/sd*1 or resize2fs -p /dev/mmcblk*p1
Getting a Developer Key
- First the XO must have a developer's key!!!
- The easiest way to go about obtaining this is to boot into the XO's Sugar OS. Open the browse application. Near the bottom right of the home page, there will be a link for "Get a Developer Key".
- Click this link and on the next page click the "Submit Query." Go through this process again after 24 hours and the key should be available.
- Upon return follow the directions displayed to download the key.
- Reboot the XO and tap the "Esc" key to interrupt the booting procedure. At the ok prompt type:
ok disable-security
- The machine will probably reboot. If so, tap the "Esc" key and type the above command again. It may reboot one final time.
- Upon this reboot tap the "Esc" key again and type the above command a final time. It should print out:
ok disable-security No wp tag
Booting the XO from the SD
More than likely, this will not work right away, most implementations require some tweaking prior to properly booting.
- With the SD card inserted in the XO, turn the machine on and press the "Esc" key to interrupt start-up.
- At the prompt type:
ok boot sd:\boot\olpc.fth
- It should attempt the boot sequence, but more than likely will fail with a Kernel Panic!!!....error
- This is almost expected, but it's actually an important step. If you look further up on the screen, you should see an error in regards to mounting the file system.
- Around this area, you should also see a list of strange numbers (i.e. b102:) followed by devices (i.e. ramdisk...)
- Find the row for your SD card, it should be labeled something like:
b301: mmcblk0p1
- Remember the b301 number.
- Connect the SD card back to the Linux PC.
- Open the file /boot/olpc.fth
- Here's a quick resource on what this is SD Booting.
- You'll see a line like this:
" ro root=mmcblk0p1 rootdelay=1 console=ttyS0,115200 console=tty0 rootfstype=ext2 fbcon=font:SUN12x22" to boot-file
- Change the "root=******" to be the variable recorded earlier.
- Save the changes and put the SD card back in the XO. Reboot the machine and at the prompt again type:
ok boot sd:\boot\olpc.fth
Post XS School Server Installation Configuration:
The following are commands that were run after installing XS on a Virtual Machine. Idealy, the newly configured SD card can now act as the operating system for the Virtual Machine allowing further versatility.
yum groupinstall "GNOME Desktop Environment" edit /etc/inittab and change runlevel from 3 to 5 to startup in Gnome yum install mysql-server php php-mysql php-mbstring php-gd php-xmlrpc php-imap cvs service mysqld start mysqladmin -u root password 'mySecurePassword' mysql -u root -p mysql> CREATE DATABASE moodle CHARSET 'utf8'; mysql> exit; chkconfig mysqld on --starts sql server; adds root admin user; logs into server and creates DB; --turns the service on on boot. cd /var/www cvs -z3 -d:pserver:anonymous@eu.cvs.moodle.org:/cvsroot/moodle co -r MOODLE_19_STABLE moodle --download and install/update with the latest version of moodle mkdir moodledata chown -R apache:apache moodle chown -R apache:apache moodledata --make directory in /var/www/ and change permissions. edit the file /etc/httpd/conf/httpd.conf change DocumentRoot "/var/www/html" to DocumentRoot "/var/www/moodle" change <Directory "/var/www/html"> to <Directory "/var/www/moodle"> then you must restart the apache server by issuing the command: service httpd restart
Documentation & Resources
Installing MySQL:
Code
Code (parser.awk) can be downloaded here
Date file (students.dat) can be downloaded here
With data in the same directory and with your PWD also as the same directory. Issue the command @ the command line:
awk -f parser.awk students.dat
Parser.awk:
#Wesley Dillingham
#Filename parser.awk
#Last updated May 17th 2009
BEGIN{
printf("%-11s%-8s%-11s%-8s%-11s%-8s%-11s%-8s%-11s%-11s\n", "Student", "Only +", "Contains +", "Only -", "Contains -", "Only
*", "Contains *", "Only /", "Contains /", "Understands OoO?")
}
{
#*****Field Reference *************
#MAC=$1
#NAME=$2
#OPERATION=$3
#SUCCESS=$4
#************************************
#Because in the end statement we will have to loop through one of the arrays, which will be localized according
#to specific aritmetic operations (- + / *). We need to account for the fact that some students may not answer a
#question with one of these operations, and if we looped through that particular operation, we would not represent
#that student in any of the logic containted within that loop in the END{} statment. Therefore an associative array
#which absolutely, accounts for any student, contained in the .dat, the CLASS[] array.
CLASS[$2]
#any line that has division, but not necessarily just.
if ( match($3, /\//) )
{
#How many division problem student $2 encounters = divison[$2]
division[$2]++
if ( $4 == "1" )
{
division_correct[$2]++
}
}
#any line with multiplication but not neccearily just multiplication
if ( match($3, /\*/) )
{
#How many multiplication problem student $2 encounters = multiplication[$2]
multiplication[$2]++
if ( $4 == "1" )
{
multiplication_correct[$2]++
}
}
#any line with addition but not necessarily just addition
if ( match($3, /\+/) )
{
#How many addition problem student $2 encounters = addition[$2]
addition[$2]++
if ( $4 == "1" )
{
addition_correct[$2]++
}
}
#contains subtractions, excludes negative numbers, as it only matches expressions with a "-" sandwiched b/w two digits
if ( match($3, /[0-9]\-[0-9]/) )
{
#How many subtraction problem student $2 encounters = subtraction[$2]
subtraction[$2]++
if ( $4 == "1" )
{
subtraction_correct[$2]++
}
}
# Matches operations with ONLY DIVISION
if ( match($3, /\//) && !match($3, /[0-9]\-[0-9]/) && !match($3, /\+/) && !match($3, /\*/) )
{
#How many ONLY division problem student $2 encounters = 0_divison[$2]
o_division[$2]++
if ( $4 == "1" )
{
o_division_correct[$2]++
}
}
# Matches operations with ONLY SUBTRACTION
if ( !match($3, /\//) && match($3, /[0-9]\-[0-9]/) && !match($3, /\+/) && !match($3, /\*/) )
{
#How many ONLY subtraction problem student $2 encounters = o_subtraction[$2]
o_subtraction[$2]++
if ( $4 == "1" )
{
o_subtraction_correct[$2]++
}
}
# Matches operations with ONLY ADDITION
if ( !match($3, /\//) && !match($3, /[0-9]\-[0-9]/) && match($3, /\+/) && !match($3, /\*/) )
{
#How many ONLY Addition problem student $2 encounters = o_addition[$2]
o_addition[$2]++
if ( $4 == "1" )
{
o_addition_correct[$2]++
}
}
# Matches operations with ONLY MULTIPLICATION
if ( !match($3, /\//) && !match($3, /[0-9]\-[0-9]/) && !match($3, /\+/) && match($3, /\*/) )
{
#How many ONLY MULTIPLICATION problem student $2 encounters = o_multiplication[$2]
o_multiplication[$2]++
if ( $4 == "1" )
{
o_multiplication_correct[$2]++
}
}
#How many problems an individual student faced: for classwide statistics we simply use the built-in var NR
numproblems[$2]++
#Determine if it is a compound operation if so increment by one, this requires 4 if's as we have to check if each of them exists in
# conjuntion with another.
#Keep track of total compounds and compounds correct.
#Else-if structure required because if stringed If's were used each compound match would register twice.
if ( match($3, /\//) && ( match($3, /[0-9]\-[0-9]/) || match($3, /\+/) || match($3, /\*/) ) )
{
compound[$2]++
if ($4 == "1") #if correct
{
compound_correct[$2]++
}
}
else if ( match($3, /[0-9]\-[0-9]/) && (match($3, /\//) || match($3, /\+/) || match($3, /\*/) ) )
{
compound[$2]++
if ($4 == "1") #if correct
{
compound_correct[$2]++
}
}
else if ( match($3, /\+/) && ( match($3, /[0-9]\-[0-9]/) || match($3, /\//) || match($3, /\*/) ) )
{
compound[$2]++
if ($4 == "1") #if correct
{
compound_correct[$2]++
}
}
else if ( match($3, /\*/) && ( match($3, /\+/) || match($3, /[0-9]\-[0-9]/) || match($3, /\//) ) )
{
compound[$2]++
if ($4 == "1") #if correct
{
compound_correct[$2]++
}
}
else # This allows for easy way to harness non compound statements, instead of going through a whole new slew of logic statements.
{
non_compound[$2]++
if ($4 == "1") #if correct
{
non_compound_correct[$2]++
}
}
if ( $4 == "1" )
{totalcorrect[$2]++}
}#end of AWK_MAIN
END{
#loops through all of the elements in the array CLASS[]
#Here We will print out the students
for (student in CLASS)
{
# A student doesnt understand order of operations if their is a greater than 20% difference in between compound
# operations and single operation instructions, but only if lower on the compound instruction side.
# or if they get less than 70% on compounds, because getting a 51% on compounds and 70% on non compounds doesnt satisfy
# understaning of OoO
if ( ( (non_compound_correct[student] / non_compound[student]) - (compound_correct[student] / compound[student]) > .2 ) ||
( (non_compound_correct[student] / non_compound[student]) ) < .7)
{
understands= "no"
}
else
{
understands= "yes"
}
#need to address divide by 0 issue
printf("%-11s%-8s%-11s%-8s%-11s%-8s%-11s%-8s%-11s%-11s\n", student,
int(o_addition_correct[student]*100/o_addition[student]), int(addition_correct[student]*100/addition[student]),
int(o_subtraction_correct[student]*100/o_addition[student]), int(subtraction_correct[student]*100/subtraction[student]),
int(o_multiplication_correct[student]*100/o_multiplication[student]),
int(multiplication_correct[student]*100/multiplication[student]), int(o_division_correct[student]*100/o_division[student]),
int(division_correct[student]*100/division[student]), understands)
}
} #end of AWK_END
After Class Plans
Wesley Dillingham
will continue this project into the summer as part of RIT's cooperative education program.
I am becoming more interested in a literal interpretation of the Massachusetts curriculum requirements and integrating them into moodle. I would like to shoot for coming up with a modified quiz module which, reads from the api which in turn reads from multiple games in order to suffice the curriculum standards, As no one game has the format to test for all of the requirements. I will be developing using php, and my immediate goal, is to provide the raw capabilities in php to understand and interpret information from the games to test understanding of guidelines. Bonus work includes, graphs, and other heuristics which the teacher may find valuable. I would like to work on helping the mathblaster game provide information relevant to my teacher reporting application via the API.
Tenative summer shedule
- Week 1: Begin learning and understanding of PHP.
- Week 2: Complete conversion of "Operations awk script" into PHP.
- Week 3: "Order of operations awk script" into PHP.
- Week 4: Gain understanding of PHP's querying of MySQL, convert above PHP scripts to gain information via MySQL rather than input file
- Week 6: Integrate above PHP scripts into Pre-existing quiz module.
- Week 7 & 8: Identify, 2 or 3 additional curriculum standards find games which can be used, to satisfy requirements, create php logic, to interpret information gained through MySQl
- Week 9: Work tangentially with mathblaster team and facilitate Mathblaster <> api and api <> teacher-reporter data exchange.
- Week 10: Begin work on teacher interface. Wrap up project, plan for adanonment or continuation.,
Jeremiah Green
will continue working on this project when time is available to devote.
- Get networking running on the XO.
- Have Moodle running on the XO.
- Have Database running on the XO.