Chasta, Bartolo, Edna discussed on The Psychology Podcast


What you know who your social group is so. The idea of testing was to go beyond that. The problem that they didn't recognize him probably couldn't have recognized. Is the test. Scores other tests would be fairly substantially correlated with the old stuff that parents who were higher. Sds socioeconomic status could afford more opportunities further kids they they lived in better school districts often so the kids went to better golf they could buy them has peration books. They could buy some courses. I could buy them tutors. They could give them stuff to do at home because they were better educated. I came from an uneducated home. Pretty much neither. My parents graduated from high school. And so you. I know what. It's like edna. Your parents don't do this kind of test preparation for they wouldn't even know what to do. He's minded in. So so what happened. Is that the traditional tests to some extent ended up laundering socioeconomic status. It's sort of like you know laundering money except it was sds. So now you've created this meritocracy that supposed to be based on mental ability but to a large extent not totally bartolo. Large extent is based on social opportunities. And then you get honestly people in the testing. She held who mostly came from upper middle her middle socioeconomic status as who keep perpetuating assistant and mean we all want the best for our kids and the people in any society who are in power want the next generation of powerful people with high opportunities to be kind of like them. Because that's what their kids are gonna be so my argument has been that. Yeah we do want to create a system where people have opportunities based on their abilities and talents but that the abilities and cowan's with measured or two frigging narrow and their risk of getting rid of to us is that will start paying too much attention to a prestigious school. Do you have college counselor. Create a list of extracurricular activities and so on instead of looking at the kids potentials. But if we're gonna look at potential we always should've looked at broader potentials. Not just narrow ones and you think that psychometric still is important in this process like we. Testing is still valuable to kind of testing. We do doesn't look anything like the kind of testing. That's because if you mean by testing giving kids trivial inconsequential unemotionally arousing artificial academic problems. Well we do. I don't think as much to do with that. I it. I just published recently. I think you started article in the new sides. Chasta's all kinds of test items. But eric kinds of air test to remind for example to countries that are competing for water resource like one is upstream on the river in the others downstream and the one that's downstream on the river claiming the upstream wine is taking too much of the water and leaving them with desert conditions and two countries are ready to go to war and say you might be asked. How would you resolve a problem that. How could you create assistant to resolve or you might get a problem where to friends of yours break up and they both text you and they want to talk to you and you know that they're both gonna tell you that you should take their side and you don't really wanna take sides but you do want to stay friends. So how do you negotiate that. Or i gave an example of a future history What would have happened. If saw the nazis in world war two or what would or pay up. And if the americans lost the american revolution whatever but our tests are very different from. They're like test of creativity are graded by rubrics for how novel and useful. The responses are a test of wisdom are graded for the extent to which our answer helps to promote a common good by balancing your own others than larger interests over the long and short terms through the use of positive ethical values. So we we we. Yeah we do assess. But i think for things that matter in life not stuff. That's easy to assess just because it's cheap and easy to assess. Yeah fair enough. I do ask the who creates these test items are you are you like. Are you good at practical intelligence. Like a you like. It's almost like the person who i wouldn't be surprised. I'm and i'm not questioning and saying doesn't seems like you're not that's not that's not my point but i'm saying you know the test constructors themselves. There's kind of an interesting thing when you kind of. Have this like assumption that like well. How do you even know the answers to the questions. Yeah so in. Terms of my practical intelligence. I was describing my practical intelligence. Were to a senior professor at yale shortly after. I got tenure there. His name was wins or gardiner and he say he interrupted me to say You should know bob that you've got tenure here. Not because of your practical intelligence. Despite it so income model of practice does but in terms of who creates the ed who creates it when i have created some staff have created. Some big problem is not so much i think creating items. It's hattie a score them instead. What we do is we create rubrics for what we're looking for in. We go through a fairly elaborate. Training process for raiders. So with tufts. That would have been for admissions officers. Eddie yale it was for staff. We hired for the sensory But we teach them. What does it mean to be creative. Verano practical we then have them practice on actual essays individually and then they get together as a group and they compare your answers until we can get high reliability in some of the raiders. Some of the raiders. We have to let go because they either can't achieve reliability or they can kind of get the idea of what we're looking for now you might say well the advantage of multiple choice dessus. They have right and wrong answers but my argument would be that. There are very few serious problems. That have just d- right in iran. Answer if you look at what you know how should we. How should we divide cova. Nineteen research resources for vaccines are resources for testing. Or how can we deal with the fact that global warming is out of control. Or how can we deal with increasing income disparities. So those are the real problems the world faces..

Coming up next