welcome to our Web Portfolio. This portfolio contains a collection of our work during TECH4102 course (Evaluation in Educational Technology) at Sultan Qaboos University. We wish you find it useful and navigate it easily.

Great thanks for our instructor Dr. Aalla Sadik who opens our insights to the educational technology world as we will graduate from Instructional and Learning Technologies Department.

This portfolio done by Hiba AL-Julandani (teacher446@gmail.com) & Tamadher AL-Za'abi (tamah4@gmail.com).

Saturday, May 9, 2009

Levels and techniques of evaluation in educational technology

Web-based quiz-game-like formative assessment: Development and evaluation
Tzu-Hua Wang
Approaches (Research design and procedure)
This research use experimental design which aims to investigate how students learning effectiveness will differ when teacher use one of three different type of formative assessment in web-based environment; paper and pencil test (PPT), normal web-based test (N-WBT), and GAM-WATA. It also tries to explore whether GAM-WATA can make students more willing to actively participate in Web-based formative assessment.
In PPT and N-WBT students can repeat the test, receive the correct answer, ask questions and check their own scores and those of peers. GAM-WATA has more features that make it different from PPT and N-WBT like Ask-Hint Strategy; students who have difficulties in answering questions are allowed to use this strategy to obtain online hints. Moreover, when students submit the answers, correct answers are not given directly, but a reference is provided. Students can query personal and peer answering history of each item. Using GAM-WATA, when students reach the level of ‘pass the test (truly answer all items correctly)’, the system will show an animation as a reward.
The researcher divides the population (165 fifth grade elementary students) to three different groups randomly. Each group will use different method of formative assessment. The research requires two weeks. Before the 2-week e-Learning course, students took the pre-test of the summative assessment. After that, each group uses one of the three different types of formative assessment for two weeks. The e-Learning environment and the items in the three different types of formative assessment were identical. After receiving the 2-week instruction, all the students had to take the post-test of the summative assessment.

Levels of evaluation
This research falls in the (learning step Level) because the context of the study focus only in teaching four concepts (water and plants, roots, stems, and leaves), which is one lesson from a course. In addition, the study require only two weeks. The researcher applies the three ways of assessment in two weeks only.

Techniques/ instruments
The researcher uses pre-post tests technique as summative assessment to conduct this research. The design of the items in the summative assessment is based on the four important concepts about plants introduced in the e-Learning environment. The design focused on the knowledge level and comprehension level defined in Bloom’s taxonomy of cognitive domain. Knowledge-level items involve recalls or recognition of ideas or concepts, and Comprehension-level items emphasize on student understanding of ideas or concepts.

No comments: