Principal, Brown, Jenny Gephardt discussed on Rework



The families can then sign up and use it on more than just the school device vice. You know in my daughter's case she and her friends were specifically researching the rates of domestic violence against women in Alaska which is ridiculously significant significant those numbers and that caused our principal to come in and chat with her about it because the principal got an email that had a list of keywords in it but didn't really know what was actually happening in the classroom. Some of the emails quite literally are just a list of the key words with the number of instances in them so it doesn't say EH. The students seems like they feel this. It says this document has this many instances of the word gun. This many instances of the word hate this many instances of the word the guy or whatever Ryan wrote an op Ed for the Juneau Empire about the use of bark in local schools in it. He argued that using the software could lead to young and people censoring themselves. He talked to one of his daughters middle school classmates. Who'd also been flagged for a false positive astor just going to change? How you do your schoolwork? And she said who are probably just won't use those words anymore. She wasn't concerned. So much about getting flagged or even at that. Her principal came talk to her. But it was more just that she didn't want to have the hassle and so rather than take a risk of having having the hassle of having to have a conversation with the principal. Well she's just going to avoid using certain words in her schoolwork and that's hard because especially in the younger grades you know you want to figure out how to get students to be as creative as possible. You don't want them to be censoring themselves in Juneau. The school district got pushback from students and parents over their roll out of bark as a result of the backlash the district got the company to make some changes like holding data for a shorter amount of time and cutting the profanity. Filter Bark also agreed to stop sending marketing emails to parents about their paid service. Yes we do need to be able to use technology to help the deal with the huge tidal wave of technology but we have to also figure out a way to bring the the humanity back to my hope for the school that my daughter goes to and and the high school that she's about to go to is that we'll have more than just these sort of false positive laden emails going going to a principal but that were actually being a bit more active about teaching students and and the adults how to how to build good academic relationships support each other. There's that false positives are worth it. If we can save those seven hundred something lives again. This Gephardt from the F. F. again kind of no evidence of what the counterfactual under factual is no evidence of what other more tried and true interventions would have done right. It's very hard to test that claim we haven't seen any independent evaluations of those is Queens. But the false positives that we see you have comical cases where for example students are texting about to kill mockingbird. There was a school where one of the teachers last last names as a razor but then we keep going down the false positive road. Well what if a student is texting about lyrics to songs with that disproportionately impact students of color or or students were listening to music by musicians of color in listening to hip hop and so it's exposing kids to much more scrutiny much more automatically in ways that have really concrete harm arm that disproportionately impact kids who might already behave in ways. That are outside the norm. It could in many districts impact. Disabled students reportedly students of color. Disproportionately we're seeing a rush across the nation really of school districts are rushed to this technological fix to these problems with huge emotional national stakes without enough investigation of what the harms could be students. Caroline Haskins buzzfeed news has identified another concerning aspect of Gaggle. It has a three strikes rule which context school officials in the case of multiple violations because the system scans for words like Gay Lesbian and Queer share. This means that a student using the word clear three times for example may get flagged so even though it's not the same as threatening another student which gets escalated to features. Choose immediately if you do something three times and Meek Goggles three-strikes roles. It's still going to get escalated. Sarah Roberts who's scholar who specializes in content automation. She also talked about how three strike roll like that invokes. The sort of logic are the judicial system in a way. That's a little bit strange for a student. Didn't that's using profanity or things that have to do with like LGBTQ expression on a school account. We're concerned about the fact that this information will be shared with law enforcement and that it could actually be used to create profiles of young people that would not have interactions with the system while they're still in school. Marie Cocco feffer corn is the executive director of the Midwest Center for school. TRANSFORMATION IN MINNEAPOLIS MINNESOTA. Her work focuses on data smart cities and education. This is data collection. This is surveillance and data collection and it just makes it much easier to criminalise students when you have all this information earlier this year. Morocco was part of a group of community leaders in Saint. Paul that helped and data sharing agreement between the public schools. The city and the county the agreement would have mused predictive analytics to assign a risk score to young people one of the indicators that they were going to use to assign Risk Gore was a student's suspension record occurred and understanding that in Minnesota. The suspensions are punitive in nature and harm a lot of black and brown children and in two thousand eighteen. I'm forty three school. Districts were identified for discriminating in out of school. Suspensions with black and Brown students there are trends that say you know a white student might do one behavior behavior. A black student do the same behavior. But it's described differently and therefore the punishment is also very different worldwide student. They're just precocious where a black student would be described as loud and disruptive the Brennan Center for Justice a think tank and advocacy group has been tracking the use of surveillance technologies in schools. It says that school district spent one point one million dollars on social media monitoring twenty eighteen off from just fifteen thousand. I was in five hundred dollars in two thousand thirteen. The Brennan Center was pulling its numbers from a database of self reporting government purchases so at thinks the real amount of spending on the software could be much higher Maria feffer Corn Jenny Gephardt and others see this environment of increased surveillance and law enforcement in schools is one that feels especially punitive to students of color and other vulnerable populations that atmosphere can lead to students getting pushed out of the traditional school system. A lot of conversation Shen has been emerging around safety in particular after the school shootings and so there are a lot of vendors out there that are providing what they're calling alternatives turnips to school districts to prevent such things from happening. What we have seen an increase in surveillance of students whether it's by having having more metal detectors the increasing use of cameras across schools school resource officers that have body cams using surveillance using gate recognition ignition on students using GPS to track where they are on school grounds? We're also seeing different kinds of text mining and kind of artificial intelligence or machine learning powered our tools to do things as simple as flagging keywords to have much more insidious things like trying to flag. What activities a kid may be interested in doing and when the way you interpret what you're reading on social media can be looked at through a racially biased lens and again you end up hyper surveilling students of color? Because of the way they talk not because of actions that would actually lead you to believe that they were a threat. There's a long history of concern with communities of color. About how how. That information is being used or will be used whether it's for identifying undocumented students with ice and sharing that information with them or it it could actually be used against families that they're collecting social media information around that one student but they're also collecting information about their siblings their peers and and their family members and so what is on one person's social media page could include a lot of people that are giving up their information without their knowledge edge. When it comes to this monitoring we look at the school shootings that have happened and it has not been are black and Brown students that have have been involved in those shootings or being the shooters and yet we see this hyper level of surveillance that's going to be happening in our urban communities that will fixate on black.

Coming up next