FREE AND STUDY GAMES ABOUT WEEK 4. PSY 3041 EXAM

PDF Download

FREE AND STUDY GAMES ABOUT WEEK 4. PSY 3041 EXAM

QUESTIONS

Actual Qs and Ans Expert-Verified Explanation

This Exam contains:

-Guarantee passing score -42 Questions and Answers -format set of multiple-choice -Expert-Verified Explanation

Question 1: Specifics of Item Discrimination Index

Answer:

Symbolised by "d" d = index of discrimination for each item Compares performance on a particular item by the high ability group i.e. top 27% of test takers and the low ability group i.e. bottom 27% of test takers *27% only if you have normal distribu

Question 2: What is the Item Discrimination Index?

Answer:

Difference in pass rate on a given test, between a high ability group and a low ability group.Those who perform well on the test as a whole should have higher pass rates for any given item than those who perform poorly overall

Question 3: What do the d values (item discrimination index values) tell us?

Answer:

d ranges from -1 to +1 A positive d value = item discriminates well

• or a negative d value = red flag! Indicates that low scoring test takers are more likely to answer a

given item correctly than high scoring test takers - item does NOT discriminate we

Question 4: Review: Test Tryout?

Answer:

This is where you have a bank of items you have created and you test how good they actually are.

Question 5: How does the item difficulty index help in item analysis process?

Answer:

Items with p values close/equal to 1 have been answered correctly by most/all. Items with p values close/equal to 0 are not answered correctly by most/all. These items don't provide discrimination between test takers and should be discarded or revised.Question 6: Why can we give finalised tests under speeded conditions and not be fussed about people guessing?

Answer:

Because all items have already been analysed. Speed and guessing will not longer interfere with our judgment, understanding and inferences about an item, unlike during the test analysis phase of development and construction.

Question 7: What is one scenario when a tool/test is considered useless?

Answer:

When there is no discrimination and therefore you can't make any decisions, the test is basically useless. A test isn't just for better understanding but also used to make decisions/judgments about people.

Question 8: Quantitative Item Analysis?

Answer:

This involves looking at means, standard deviations, distributions of scores we obtain etc.

Question 9: s - item score standard deviation

Answer:

Item score standard deviation of item 1 would be denoted by s1 s1 = sqrt(p1(1-p1)) where p1 is the item difficulty index for item 1.

Question 10: Item validity index

Answer:

Degree which a test measures what it purports to measure.Criterion validity is one way to measure validity.

Calc:

Item validity index = Item score std dev (s1) x correlation between (r1c)item score & score on criterion measure High r = better item

Question 11: How do we approach the Item Discrimination?

Answer:

Two approaches:

1.Item total correlations: closely related to item reliability. It is the correlation between each item and total test score. Higher correlation=greater internal consistency of test 2.Index of discrimination

Question 12: r - correlation between item and overall test

Answer:

High correlations (r) suggests good item: item is measuring same thing as test.

Low correlations (r)suggests a poor item: item is measuring something slightly/completely different from the test as a whole

Question 13: How does speeded tests effect item analysis?

Answer:

Speeded items also interferes with out ability to draw inferences and judge items. e.g. if items were failed due to lack of time, this is interpreted as an incorrect response thereby interfering with how we understand an item

Question 14: Calculation of Reliability of Individual Items

Answer:

Reliability index of individual items calculation:

Item score standard deviation (s1) x The correlation between item score and total test score (r1t) Question 15: How does guessing (in selected response format questions) impact item difficulty?

Answer:

Guessing must be accounted for in selected response formats Average optimal item difficulty, is mid-way between 1 & probability of guessing correctly e.g.In true-false: prob of guessing correctly=0.5, therefore optimal average item difficulty is p=0.75

Question 16: How does an item characteristic curve discriminate?

Answer:

The shape of the curve reveals the extent an item discriminates between high ability and low ability

groups:

Steeper curve = greater discrimination

Also used to judge fairness of an item:

More difficult and item = curve shifts more to the right

Question 17: Does it matter which of the four item analysis tools you use?

Answer:

Any of the four tools of item analysis tend to yield similar decisions; there will be some differences, but good items have a number of difference dimensions, so you tend to arrive at similar points in judgment irrespective of which tool used.Question 18: What are the pros and cons of the "think aloud" method of qualitative analysis?

Answer:

Some mental processes involved in working out an answer can be verbalised, but not all mental processes used to arrive to an answer are available for declaration. e.g. we don't have access to intuitive judgments, which are automatic, fast and unconscious.Question 19: We have looked at quantitative analyses, now what about qualitative analyses?

Answer:

Qualitative analyses completement quantitative analyses.Very useful for understanding why items aren't performing as expected

Question 20: What are two popular approaches to qualitative analysis?

Answer:

1.Getting test taker to "think aloud", done during test administration to give us an insight into thinking 2.Expert Panels: ppl from different communities/backgrounds to ascertain fairness of test

Question 21: What is the Item Discrimination Index?

Answer:

The degree to which an item differentiates correctly on the behaviour the test is designed to measure.

Question 22: What is the overall item difficulty index?

Answer:

Found by averaging individual p (difficulty index for each item in test) values, yielding overall item difficulty of test.Ideally average item difficulty is 0.5, but generally individual item difficulty ranges from 0.3 (quite hard) to 0.8 (quite easy)