{"id":25193,"date":"2022-12-22T00:43:26","date_gmt":"2022-12-22T00:43:26","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2022\/12\/22\/finally-an-interesting-twitter-files-that-appears-to-reveal-sketchy-government-behavior\/"},"modified":"2022-12-22T00:43:26","modified_gmt":"2022-12-22T00:43:26","slug":"finally-an-interesting-twitter-files-that-appears-to-reveal-sketchy-government-behavior","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2022\/12\/22\/finally-an-interesting-twitter-files-that-appears-to-reveal-sketchy-government-behavior\/","title":{"rendered":"Finally! An Interesting Twitter Files That Appears To Reveal Sketchy Government Behavior"},"content":{"rendered":"

<\/a>\n<\/p>\n

\n

from the took-them-long-enough<\/i> dept<\/h3>\n

We finally have an interesting edition of the Twitter files!<\/p>\n

When the Twitter Files began, I actually expected something<\/em> interesting to come out of them. All of the big tech companies have been unfortunately unwilling to be as transparent as they could be about how their content moderation practices work. Much of the transparency we\u2019ve received has been either through whistleblowers leaking information (which is often misinterpreted by journalists<\/a>) or through the companies partnering with academics, which often leads to rather dry analysis of what\u2019s happening, and which maybe a dozen people read. There have been moments of openness, but the messy stuff gets hidden.<\/p>\n

So I had hoped that when Elon took over and announced his plans to be transparent about what had happened in the past, we might actually learn some dirt. Because there\u2019s always some<\/em> dirt. The big question was what form that dirt might take, and how much of it was systemic rather than one-time errors and mistakes. But, until now, the Twitter Files have been worse than useless. They were presented by journalists who had neither the knowledge nor the experience to understand what they were looking at, combined with an apparent desire to present the narrative in a certain framing. <\/p>\n

Because of that, I\u2019ve written multiple posts walking through the \u201cevidence\u201d<\/a> presented, and showing how Musk\u2019s chosen reporters didn\u2019t understand things<\/a> and were misrepresenting reality<\/a>. Given that most journalist know to put the important revelations up top, and that each new \u201crelease\u201d in the Twitter files seemed more breathless, but less interesting, that the previous ones, I was basically expecting nothing at all of interest to come from the files. Indeed, that was a disappointment. <\/p>\n

As Stanford\u2019s Renee DiResta noted, this was a real missed opportunity<\/a>. If the files had actually been handed over to people who understand this field, what was important, and what was banal everyday trust & safety work, the real stories could have been discussed.<\/p>\n

\n

The Twitter Files thus far are a missed opportunity. To settle scores with Twitter\u2019s previous leaders, the platform\u2019s new owner is pointing to niche examples of arguable excesses and missteps, possibly creating far more distrust in the process. And yet there is a real need for public understanding of how platform moderation works, and visibility into how enforcement matches up against policy. We can move toward genuine transparency\u2014and, hopefully, toward a future in which people can see the same facts in similar ways.<\/em><\/p>\n<\/blockquote>\n

So when the Intercept\u2019s Lee Fang kicked off the 8th installment of the Twitter files, I was not expecting much at all. After all, Fang was one of the authors of the very recent garbage Intercept story<\/a> that totally misunderstood the role of CISA in the government and (falsely) argued that the government demanded Twitter censor the Hunter Biden laptop story. The fact that the evidence from the Twitter files totally disproved<\/a> his earlier story should at least result in Fang questioning his understanding of these things.<\/p>\n

And yet\u2026 it appears that he may have (finally) legitimately found a real<\/em> story of malfeasance in the Twitter files in his most recent installment. Like all the others, he initially posted his findings \u2014 where he admits he was granted access to Twitter\u2019s internal systems via a Twitter-employed lawyer who would search for and access the documents he requested \u2014 on Twitter in a messy and hard to follow thread. He then posted a more complete story<\/a> on The Intercept.<\/p>\n

The story is still somewhat messy and confused, and it\u2019s not entirely clear Fang even fully realizes what he found, but it does suggest serious malfeasance on the part of the government. It actually combines a few other stories we\u2019ve covered recently. First, towards the end of the summer, Twitter and Meta announced that they had found and taken down a disinformation campaign<\/a> running on their platforms \u2014 and all signs suggested the campaign was being run by the US government.<\/p>\n

As was noted at the time, the propaganda campaign did not appear to be all that successful. Indeed, it was kind of pathetic. From the details, it sounded<\/em> like someone in the US government had the dumb idea of \u201chey, let\u2019s just create our own propaganda social media accounts to counter foreign propaganda accounts,\u201d rather than embracing \u201chey, we\u2019re the US government, we can just speak openly and transparently.\u201d The overall failure of the campaign was\u2026 not surprising. And we were happy that Twitter and Meta killed the campaign (and now we\u2019re hearing that the US government is doing an investigation into how this campaign came to be in the first place).<\/p>\n

The second recent story we had was about Meta\u2019s \u201cXcheck\u201d program, which was initially revealed<\/a> in the Facebook files as a special kind of \u201cwhitelist\u201d for high profile accounts. Meta asked the Oversight Board to review the program, and just a few weeks ago the Oversight Board finally released its analysis<\/a> and suggestions (after a year of researching the program). It turns out that it\u2019s basically just like what we said when the program was first revealed: after a few too many \u201cfalse positives\u201d on high profile accounts became embarrassing (for example, then President Obama\u2019s Facebook account was taken down because he recommended the book \u201cMoby Dick\u201d and there was an automated flag on the word \u201cdick\u201d), someone at Facebook instituted the Xcheck program to effectively whitelist high profile individuals so that flags on their account would need to be reviewed by a human before any action was taken.<\/p>\n

As we discussed in our podcast about Xcheck, in many ways, Facebook was choosing to favor \u201cfalse negatives\u201d for high profile accounts over \u201cfalse positives.\u201d The end result, then, is that high profile accounts are effectively allowed to get away with more, and violate the rules with a larger lag for consequences, but they\u2019re less likely to be suspended accidentally. Tradeoffs. The entire content moderation space is full of them.<\/p>\n

Again as we noted when that story first came out, basically every<\/em> social media platform has some form of this in action. It almost becomes necessary to deal with the scale and not accidentally ban your most high profile users. But, it comes with some serious risks and issues, which are also highlighted in the Oversight Board\u2019s policy recommendations<\/a> regarding Xcheck.<\/p>\n

Thus, it\u2019s not at all surprising that Twitter clearly has a similar whitelist feature. This was actually somewhat revealed in an earlier Twitter File when Bari Weiss, thinking she was revealing unfair treatment of the @LibsOfTikTok account, actually<\/em> revealed it was on a similar Xcheck style whitelist that clearly showed a flag on the account saying DO NOT TAKE ACTION ON USER WITHOUT CONSULTING<\/strong> an executive team.<\/p>\n

\n
\"\"<\/figure>\n<\/div>\n

That\u2019s all background that finally gets us to the Lee Fang story. It reveals that the US government apparently got some of its accounts onto this whitelist after they had been dinged earlier. The accounts, at the time, were properly labeled as being run by the US government. But here\u2019s the nefarious bit: sometime after that, the accounts changed to no longer be transparent about the US government being behind them, but because they were on this whitelist<\/em> it\u2019s likely that they were able to get away with sketchy behavior with less review by Twitter, and it likely took longer to catch that they were engaged in a state-backed propaganda campaign.<\/p>\n

As the article notes, in 2017, someone at the US government noticed that these accounts \u2014 which, again, at the time clearly said they were run by the US government \u2014 were somehow limited by Twitter:<\/p>\n

\n

On July 26, 2017, Nathaniel Kahler, at the time an official working with U.S. Central Command \u2014 also known as CENTCOM, a division of the Defense Department \u2014\u00a0emailed<\/a>\u00a0a Twitter representative with the company\u2019s public policy team, with a request to approve the verification of one account and \u201cwhitelist\u201d a list of Arab-language accounts \u201cwe use to amplify certain messages.\u201d<\/em><\/p>\n

\u201cWe\u2019ve got some accounts that are not indexing on hashtags \u2014 perhaps they were flagged as bots,\u201d wrote Kahler. \u201cA few of these had built a real following and we hope to salvage.\u201d Kahler added that he was happy to provide more paperwork from his office or SOCOM, the acronym for the U.S. Special Operations Command.<\/em><\/p>\n<\/blockquote>\n

\n
\"\"<\/figure>\n<\/div>\n

Now, it seems reasonable to question whether or not Twitter should have put them on a whitelist in the first place, but if they were properly marked, and not engaged in violative behavior, you can see how it happened. But Twitter absolutely<\/em> should have had policies stating that if those accounts have their descriptions or names or whatever changed, the whitelist flag should automatically be removed, or at least sent up for a human review to make sure it was still appropriate. And that apparently did not happen.<\/p>\n

As The Intercept report notes, Twitter at this time was under tremendous<\/em> pressure from basically all corners about the fact that ISIS was an effective user of social media for recruitment and propaganda. So the company had been somewhat aggressive in trying to stamp that out. And it sounds like the US accounts got caught up in those efforts.<\/p>\n

So there is a lot of interesting stuff revealed here: more details on the US government\u2019s foreign social media propaganda campaigns, and more evidence of how Twitter\u2019s \u201cwhitelist\u201d program works and the fact that it did not appear to have very good controls (not that surprising, as almost no company\u2019s similar tool has good controls, as we saw with the OSB\u2019s analysis of Xcheck for Meta).<\/p>\n

But\u2026 the spin that \u201cTwitter aided the Pentagon in its covert online propaganda campaign,\u201d is, yet again, kinda missing the important stuff here. Neither the Pentagon nor Twitter look good in this report, but in an ideal world it would lead to more openness (a la the OBS\u2019s look into Xcheck) regarding how Twitter\u2019s whitelist program works, as well as more revelations about how the DOD was able to run its foreign propaganda campaign, including how it changed Twitter accounts from being public about their affiliation to hiding it.<\/p>\n

This is where it would be useful if a reporter who understood how all this worked was involved in the research and could ask questions of Twitter regarding how big the whitelist is (for Meta it reached about 6 million users), and what the process was for getting on it. What controls were there? Who could put people on the whitelist? Were there ever any attempts to review those who were on the whitelist to see if they abused their status? All of that would be interesting to know, and as Renee DiResta\u2019s piece noted, would be the kinds of questions that actual experts would ask if Elon gave them access to these files, rather than\u2026 whoever he keeps giving them to.<\/p>\n

\nFiled Under: dod<\/a>, propaganda<\/a>, social media<\/a>, whitelist<\/a>, xcheck<\/a>
\n
Companies: twitter<\/a>\n<\/p>\n<\/div>\n