What 684 investigations taught us

After analysing 4,359 contradictions across 68 categories, two patterns dominate: some categories have genuinely less harmful options. Most don't.

684Products investigated
4,359Contradictions found
3,443Sources cited
68Categories
Where good options exist

These categories have at least one product built on a privacy-first business model. Not perfect — but meaningfully less harmful than the alternatives.

Messaging
C
Signal
Non-profit foundation. End-to-end encrypted by default. No ads, no trackers, no data sales. 10 contradictions found — but none critical, and all relate to metadata edge cases rather than deliberate exploitation.
View full investigation →
Runner-up: None at comparable quality. Telegram is not end-to-end encrypted by default.
Password Manager
B
KeePassXC
Fully offline, open-source, no cloud sync, no account needed. Your passwords never leave your machine. 3 contradictions, all low severity. The trade-off is convenience — no automatic sync across devices.
View full investigation →
Runner-up: Bitwarden (grade B) — open-source with optional cloud sync. Best balance of security and usability.
VPN
B
Mullvad VPN
No email required. No account names — just a random number. Accepts cash by post. Independently audited. Swedish jurisdiction (no Five Eyes). 5 contradictions, zero critical. When police seized their servers, there was nothing to find.
View full investigation →
Runner-up: Proton VPN (grade D) — Swiss jurisdiction, open-source apps, but more contradictions.
Email
B
Tuta Mail
German jurisdiction (strong GDPR enforcement). End-to-end encrypted including subject lines. No ads. Open-source. 4 contradictions, none critical. Tuta fought a German court order to build a surveillance backdoor — and won.
View full investigation →
Runner-up: Proton Mail (grade D) — Swiss, end-to-end encrypted, but complied with French police IP logging order.
Browser
B
LibreWolf
Firefox fork with telemetry stripped out. No Mozilla data collection, no Pocket integration, no sponsored content. Community-maintained. 3 contradictions, all low severity. The trade-off: no auto-updates, you manage that yourself.
View full investigation →
Runner-up: Firefox (grade C) — good baseline but Mozilla's ad experiments and telemetry defaults are a concern.
Cloud Storage
B
Proton Drive
End-to-end encrypted. Swiss jurisdiction. Zero-access encryption means even Proton can't read your files. 3 contradictions, all low. Smaller storage limits than Google Drive, but Google scans every file you upload.
View full investigation →
Runner-up: Tresorit (grade B) — Swiss Post-owned, end-to-end encrypted, slightly more enterprise-focused.
Search Engine
B+
Kagi
Paid search engine — you're the customer, not the product. No ads, no tracking, no profiling. 3 contradictions, all low. The $10/month fee is the point: it removes the incentive to harvest your search history.
View full investigation →
Runner-up: Brave Search (grade B) — independent index, no tracking, free tier available.
Antivirus
B
ClamAV
Open-source, no cloud scanning, no behavioural tracking. Most antivirus products (Norton, Avast, Kaspersky) have been caught selling browsing data, mining crypto, or acting as spyware themselves. ClamAV just scans files.
View full investigation →
Runner-up: Malwarebytes (grade B) — minimal data collection, no history of data sales.
Video Conferencing
B
Jitsi Meet
Open-source, self-hostable, no account required. End-to-end encrypted. No recording by default. Zoom was caught routing calls through China and lying about encryption. Jitsi puts the server choice in your hands.
View full investigation →
Runner-up: None comparable. Google Meet and Teams are both surveillance platforms with video features.
Where every option fails
These categories have no genuinely privacy-respecting product. Every option we investigated has serious documented concerns. The honest advice isn't "choose wisely" — it's "know what you're accepting."
Smart TVs
Every smart TV we investigated sells your viewing data. Samsung screenshots your screen every 500ms. Texas AG sued Samsung, Sony, LG, Hisense, and TCL for ACR surveillance. Hisense received the first-ever restraining order against a TV maker. Hisense and TCL are subject to Chinese intelligence law.
Honest advice: Use a dumb monitor or projector with a separate streaming device. If you already own a smart TV, disconnect it from WiFi and use an external stick instead.
Best of the worst: Crystal UHD DU7200 (2024) (grade D) — settled with Texas AG, but ACR is industry-wide.
Vehicles
Every connected car we investigated collects location, driving behaviour, voice recordings, and passenger data. GM sold driving data to insurers behind drivers' backs. VW leaked 800,000 owners' GPS locations. Subaru's admin portal let researchers unlock any car and pull a year of location history. Honda generates 25GB of data per hour of driving.
Honest advice: Buy a pre-2015 vehicle with no cellular modem. If you must buy new, Mazda and Rivian collect less — but "less" is relative when the baseline is total surveillance.
Best of the worst: Rivian R1T / R1S (grade C) — fewest contradictions, but still a connected vehicle with always-on data collection.
Social Media
The business model is the problem. If the product is free and ad-supported, your behaviour is the product. Meta, TikTok, X, Snapchat — all optimise for engagement at the documented cost of mental health, especially for children.
Honest advice: Mastodon (grade B) and Bluesky (grade C) are less harmful but lack network effects. The real question is whether you need social media at all — the harm is the engagement model, not just the data collection.
Best of the worst: Mastodon (grade B) — ad-supported but less algorithmically toxic than feed-based platforms.
Android Phones
Every Android phone runs Google Play Services — a system-level process you can't uninstall that continuously sends data to Google. Samsung, Xiaomi, and Oppo add their own tracking layer on top. You're choosing between one surveillance layer or two.
Honest advice: A stock Pixel with hardened settings is the least bad Android option — one tracking layer instead of two. For actual privacy, you'd need GrapheneOS, which most people won't install.
Best of the worst: Pixel 8 (grade D) — no OEM bloatware, fastest security patches, but still Google at the core.
Robot Vacuums
Every robot vacuum we investigated maps your home and sends that map to the cloud. Ecovacs was hacked live on stage at DEF CON. Roborock sends room dimensions to Beijing. iRobot's Amazon acquisition was blocked over surveillance concerns — then Roomba data leaked anyway.
Honest advice: A non-smart vacuum cleaner works fine. If you insist on a robot, block its internet access at the router — most will still vacuum without cloud connectivity, they just lose app control.
Best of the worst: 360 Vis Nav (grade C) — processes more data on-device, but still cloud-connected by default.
Smart Speakers & Audio
Always-on microphones by design. Amazon hired thousands of contractors to listen to Alexa recordings. Google kept voice data it promised to delete. Apple's Siri recordings captured drug deals and medical appointments. Sonos removed a "never sell data" promise.
Honest advice: A Bluetooth speaker with no voice assistant does the same job without the microphone. If you want smart home control, a local-only setup like Home Assistant with a dumb speaker is possible but requires effort.
Best of the worst: AirPods Pro 2 (grade C) — headphones without always-on assistant, but still Apple ecosystem telemetry.
Education Tech
Proctorio punishes disability and skin colour. Gaggle outs LGBTQ+ students to hostile families. GoGuardian shares flags with police automatically. Turnitin's AI detector can't tell a second language from a chatbot. PowerSchool exposed 62 million children's records because it didn't have MFA. Canvas was breached twice in 8 months.
Honest advice: There is no safe option that schools actually use. Moodle (open-source, self-hosted) is genuinely private — but most schools can't afford the IT staff to run it. Ask your school which monitoring tools they use, what data they collect, and whether monitoring continues after school hours.
Best of the worst: Moodle LMS (grade B+) — open-source, self-hosted, school controls all data — but requires IT resources most schools don't have.
Government Apps
COVIDSafe cost $9.1 million and found 2 contacts. myGov had $557 million in identity fraud. Police accessed QR check-in data meant for contact tracing. Aadhaar exclusion killed an 11-year-old. ID.me's facial recognition had racial bias baked in. You cannot opt out of government services.
Honest advice: You have no alternative. These apps are mandatory for accessing government services. The privacy failures are structural: governments outsource to the lowest bidder, require biometrics without adequate protection, and face no consequences when things go wrong.
Best of the worst: myGov App (grade F) — the front door to every government service, with Google Analytics tracking every visit.
By the numbers

Aggregate data across all 684 investigations.

What we found

Spying
1,484
Data Sharing
1,089
Security
930
Honesty
856

Verdicts

REPLACE
327
CONFIGURE
210
ACCEPTABLE
114
OK
33

Grades

B+ (6)
 
B (39)
 
C (145)
 
D (262)
 
F (232)
 
72% of products graded D or F. Only 7% scored B or above.

Data jurisdictions

United States
2313
376 dev
China
826
103 dev
Australia
251
47 dev
South Korea
182
20 dev
Japan
103
18 dev
Germany
73
13 dev
United Kingdom
72
15 dev
United States
71
15 dev
USA (CLOUD Act) and China (National Intelligence Law) dominate contradictions from identified jurisdictions.

Worst manufacturers

Google
277
35 dev
Microsoft
144
15 dev
Apple
135
17 dev
Samsung
115
12 dev
TP-Link
113
12 dev
Amazon
89
12 dev
Meta Platforms
72
7 dev
Xiaomi
67
6 dev
Wyze Labs
46
5 dev
Tesla
36
4 dev
Google (277)Microsoft (144)Apple (135)Samsung (115)TP-Link (113)Amazon (89)Meta Platforms (72)Xiaomi (67)eufy (55)Wyze Labs (46)Tesla (36)Ring (34)LG (33)Match Group (30)Dyson (27)BYD (27)Services Australia (24)Huawei (24)Garmin (24)Roborock (23)Roku (22)ByteDance (21)Lumi United (20)Lenovo (20)Nord Security (20)