I Built an Analysis on “Verified” Sources. Three Weeks Later, It All Fell Apart

Many people wonder who I find the information that I do and why I report on certain things but not on other things. Years ago I wrote a piece called, “Why the News Isn’t Talking About that One Thing You Saw on Facebook.” I spent two weeks building what I thought was an airtight analysis. I had sources, citations and confidence. Besides, I’m a professional and I know what I’m doing. However, my readership is sharp and three weeks after publication, someone sent me a single link that unraveled the entire foundation.

The source I’d relied on wasn’t lying exactly. It was just three steps removed from the original information, and each step had introduced subtle distortions that changed perspectives. By the time the information reached me, the context had shifted just enough to make my conclusions wrong, not spectacularly wrong but wrong enough to matter, especially as someone who values accuracy a great deal.

That’s when I learned something uncomfortable: verification isn’t binary. There’s no clean line between “verified” and “unverified.” There’s a hierarchy of source reliability that most people never think about. It is the basic of media literacy and I thought that now I could use my own mistake to educate everyone on how sources and verification really work. In an age of AI, this is a growing concern and we’ll all need to be much more discerning in the coming years.

The Moment Everything Changed

I was working on a piece about media narratives around a policy debate. I found what looked like solid information from a respected publication. They cited another source. That source cited another. I followed the chain back two levels and stopped. That felt like enough but it really wasn’t enough. When the correction came, it came from someone who’d done what I hadn’t: they’d gone all the way back to the primary source. And the primary source said something meaningfully different from what had been reported three layers up.And I will say that this happened all the time when studies and things get reported with sensationalist headlines that are far more stark than what the scientiests were up to, climate change is particularly bad about this media dynamic. The facts hadn’t changed (facts are stubborn things) but the framing had changed a great deal and often it is the framing that matters most.

What Professional Fact-Checkers Actually Do

After that experience, I started studying how professional fact-checkers work. What I found surprised me. According to journalism verification frameworks, the times journalists most often get something wrong is when they take information from someone else and fail to check it themselves. Again, climate reporting is the worst in this area. Scientists post a complicated and nuanced study and by the time we read about in the news, the headline is not reflective of what was really said. The most reliable work is what you’ve done yourself and can directly verify. However, I do not often observe news events directly.

But here’s what really changed how I think about this: professional fact-checkers ask two questions, not one. The first question is obvious: “How do you know that?” The second question is what separates amateurs from professionals: “How else do you know that?” That second question is everything. It’s the difference between having a source and having verification.

The Source Hierarchy I Now Use

I built a simple framework after my analysis collapsed. It’s not perfect, but it keeps me from making the same mistake twice.

Tier 1: Primary Sources

These are as close as you can get to the origin of a fact. Original documents. Direct observation. First-hand accounts from people who were there. When I’m working on analysis now, I try to get at least one primary source for any major claim. If I can’t, I note that limitation explicitly.

Tier 2: Direct Secondary Sources

These are one step removed. A journalist who interviewed the person. An organization that compiled the original data. A researcher who analyzed the primary documents. The editorial fact-checking rule is that each fact should be confirmed with at least one primary source or two secondary sources. That’s the minimum standard.

Tier 3: Indirect Secondary Sources

These are two or more steps removed. Someone reporting on someone else’s reporting. Analysis of analysis. Summaries of summaries. This is where most of my information lives, and that’s fine as long as I know it. The problem comes when I treat Tier 3 sources like Tier 1 sources.

Tier 4: Memory and Assumption

When fact-checkers are asked what type of errors they encounter most frequently, they usually say those that occur when journalists write from memory. Human memory fails even experienced professionals. If I think I know something, I check it anyway. Every time.

The Stanford Study That Changed How I Evaluate Sources

The Stanford History Education Group ran a study that would terrify anyone who writes about current events. They tested three groups on their ability to evaluate website credibility: PhD historians, Stanford undergraduates, and professional fact-checkers. The results were stark, especially given that these are educated and thoughtful people.

The fact-checkers identified credible sources within seconds and were fastest and most accurate. Meanwhile, 65% of Stanford students and 50% of historians were deceived by unreliable sources. The difference wasn’t intelligence or education. It was how they evaluated the sources and who they trusted. The historians and students stayed on each website, read the “about” section, looked for misspellings and banner ads. They tried to evaluate credibility from within the source itself. Now consider that most people don’t even go that far and read something random on social media.

The fact-checkers did something different: they opened new browser tabs and searched using Google and Wikipedia. They practiced what’s called lateral reading, leaving the source to verify it from outside.

The Questions I Ask Before Trusting Information

I keep a simple checklist now. Five questions that take less than two minutes to answer:

1. Am I looking at the original?

If not, can I find it? If I can’t find the original, that’s a red flag. Who knew what and when?

2. Who created this?

Not just the byline. Who’s behind the organization? What’s their track record? What do independent sources say about them? What is their bias? Ground news is helpful to suss out new publications.

3. When was this created?

Context changes meaning. A statement from 2019 might mean something different in 2026. This is even true of my own work, some of my older articles are not as accurate as they were at the time and often there are updates that I’ve posted since then or my opinion has changed.

4. Where was this created?

Geographic and institutional context matters. Information created in different environments carries different assumptions and might be for a different audience who has knowledge context that we wouldn’t have otherwise.

5. Why was this created?

What’s the motivation? Who benefits from this information being shared? That doesn’t make it wrong, but it helps me understand what I’m reading. This is especially true when the information is being proposed by an organization with dubious origins or unclear funding.

What Changed After I Started Using This Framework

I’m slower now. That’s the honest truth. I used to be able to turn around analysis quickly because I trusted my sources at face value. Now I spend more time verifying and less time writing. But I haven’t had to issue another correction.

The framework doesn’t eliminate uncertainty. It helps me understand the level of uncertainty I’m working with. When I’m relying on Tier 3 sources, I say so. When I can’t get to the primary source, I acknowledge that limitation.

The goal isn’t perfect certainty. The goal is appropriate confidence matched to the quality of information.

The Environment We’re Working In Now

This matters more in 2026 than it did when I started in 2014 or even way back in 2005 when the media environment was quite different. Artificial intelligence has industrialized misinformation. Deepfakes that once required specialized expertise can now be generated in seconds. Fabricated images appear so convincing that even trained professionals struggle to identify manipulation.

Meta closed its independent fact-checking service in January 2025. X is now commonly regarded as a highly partisan platform where the truthfulness of posts is unregulated although the community notes system is supposed to keep things honest. The infrastructure that used to help us verify information is eroding. That means the responsibility falls more heavily on each of us to develop our own verification practices.

What This Means For How You Consume Information

You don’t need to become a professional fact-checker. But you can adopt some of their practices. When you encounter information that matters, open a new tab. Search for what others say about the source.

Pay attention to the source hierarchy. Notice when you’re reading primary sources versus summaries of summaries. That doesn’t mean you can’t use secondary sources. It means you should know what you’re working with. And when you’re not sure about the provenance of something, say so. There’s no shame in appropriate uncertainty. You’ll hear me do the same on The Cameron Journal Newshour all the time. The shame is in false confidence built on information that might not be what you hoped it was really saying.

The Real Lesson

The analysis I built years ago wasn’t wrong because I was lazy or careless. It was wrong because I didn’t understand that verification has layers. I treated all sources as equally reliable as long as they came from credible publications. I didn’t understand that credible publications can accurately report information that’s still three steps removed from the truth. The framework I use now isn’t complicated. It’s just deliberate.

Before I trust information, I ask where it comes from. I look for the original. I search for what others say. I ask how else I know this. And when I can’t verify something to the level I need, I say that explicitly. That’s the difference between being informed and being confident you’re informed. And in the media environment we’re living in now, that difference matters more than ever.