Ace of Spades HQ

« Top Headline Comments (11-25-2013) | Main | ~~Seattle~~ Tacoma Paper Refuses To Run Obama's White House Propaganda »

November 25, 2013

NYT: NSA's info snarfing had to be reduced because the data was overwhelming

This is something I've remarked on in comments previously. Its possible to have too much information if the retention selection criteria are too loose.

... In a world of ballooning communications, the agency is sometimes simply overwhelmed. In 2008, the N.S.A.’s Middle East and North Africa group set about updating its Sigint collection capabilities. The “ambitious scrub” of selectors — essentially search terms — cut the number of terms automatically searched from 21,177 to 7,795 and the number of messages added to the agency’s Pinwale database from 850,000 a day to 450,000 a day.

The reduction in volume was treated as a major achievement, opening the way for new collection on Iranian leadership and Saudi and Syrian diplomats, the report said...

***Put stuff here about combinatorial explosion
***Put stuff here about curse of dimensionality

This was lingering in draft, and I'm probably not going to ever finish it..but its interesting anyway.

posted by Purp at 11:01 AM

| Access Comments


Advertise Here! Intermarkets' Privacy Policy Support Donate to Ace of Spades HQ! Contact Ace: aceofspadeshq at gee mail.com Buck: buck.throckmorton at protonmail.com CBD: cbd at cutjibnewsletter.com joe mannix: mannix2024 at proton.me MisHum: petmorons at gee mail.com J.J. Sefton: sefton at cutjibnewsletter.com Recent Entries Quick Hits The Regime Vomits Up Two Eleventh Hour Hits on RFKJr. and Tulsi Gabbard "Star" of Fake Captain America Movie: I Don't Think That Captain America Should Represent America, But Instead Good Things Like Truth and Integrity Former CNN Thumb Chris Cillizza: I'm Totally Surprised That Trump Was Right About Covid Origins and Anthony Fauci Wrong; It Just Never Occurred to Me That the President of the United States Might Have Access to Secret Information I Didn't Have More Karoline Leavitt: It's Nice of You to Suddenly Care About the Price of Eggs, But the Increase Happened While the President You Corruptly Covered for Was "Sleeping Upstairs in the Residence" Karoline Leavitt's First Press Briefing Features a Roll Call of the Criminal Aliens The Democrats Protected for Decades and Who Trump Has Now Arrested Sean Duffy Confirmed as Secretary of Transportation Sean Duffy Confirmed as Secretary of Transportation; Karoline Leavitt's Inaugural Press Briefing Features a Slideshow of Now-Arrested Criminal Aliens and Their Crimes Jm J. Acosta Flounces Off CNN, Suggesting That CNN Is "Bowing to a Tyrant" for Shitcanning Him The Morning Rant: Minimalist Edition Absent Friends Bandersnatch 2024 GnuBreed 2024 Captain Hate 2023 moon_over_vermont 2023 westminsterdogshow 2023 Ann Wilson(Empire1) 2022 Dave In Texas 2022 Jesse in D.C. 2022 OregonMuse 2022 redc1c4 2021 Tami 2021 Chavez the Hugo 2020 Ibguy 2020 Rickl 2019 Joffen 2014 AoSHQ Writers Group A site for members of the Horde to post their stories seeking beta readers, editing help, brainstorming, and story ideas. Also to share links to potential publishing outlets, writing help sites, and videos posting tips to get published. Contact OrangeEnt for info: maildrop62 at proton dot me Cutting The Cord And Email Security Cutting The Cord [Joe Mannix (not a cop)] Cutting The Cord: It's Easier Than You Think [Blaster] Private Email and Secure Signatures [Hogmartin] Moron Meet-Ups	« Top Headline Comments (11-25-2013) \| Main \| ~~Seattle~~ Tacoma Paper Refuses To Run Obama's White House Propaganda » November 25, 2013 NYT: NSA's info snarfing had to be reduced because the data was overwhelming This is something I've remarked on in comments previously. Its possible to have too much information if the retention selection criteria are too loose. ... In a world of ballooning communications, the agency is sometimes simply overwhelmed. In 2008, the N.S.A.’s Middle East and North Africa group set about updating its Sigint collection capabilities. The “ambitious scrub” of selectors — essentially search terms — cut the number of terms automatically searched from 21,177 to 7,795 and the number of messages added to the agency’s Pinwale database from 850,000 a day to 450,000 a day. The reduction in volume was treated as a major achievement, opening the way for new collection on Iranian leadership and Saudi and Syrian diplomats, the report said... *Put stuff here about combinatorial explosion *Put stuff here about curse of dimensionality This was lingering in draft, and I'm probably not going to ever finish it..but its interesting anyway. posted by Purp at 11:01 AM \| Access Comments <script language="javascript" src="http://adserver.adtechus.com/addyn/3.0/5235/1131537/0/170/ADTECH;loc=700;cookie=info;target=_blank;key=key1+key2+key3+key4;grp=[group]"></script><noscript><a href="http://adserver.adtechus.com/adlink/3.0/5235/1131537/0/170/ADTECH;loc=300;key=key1+key2+key3+key4;grp=[group]" target="_blank"><img src="http://adserver.adtechus.com/adserv/3.0/5235/1131537/0/170/ADTECH;loc=300;key=key1+key2+key3+key4;grp=[group]" border="0" width="300" height="250"></a></noscript>	Recent Comments steevy: "Oh and remember Trump said no Chinese spy balloons ..." Trump poisoned my cat: "Tillis needs to go either way, and, yes, if that m ..." [/i][/i][/b][/b]Christopher R Taylor[/i][/i][/b][/b]: "[i]Pistol Pete Pulls Milley's security detail and ..." Allen : "Tillis is human slime. ..." Marcus T: "We call Caroline Kennedy “faccia da figaR ..." steevy: "That fat fuck admitted openly that he ignored the ..." Oldcat: "Apparently Scott Pressler and Dan Bongino have app ..." Disinterested FDA Director: "I think Ol' Thom was ready to vote "No" on Hesgeth ..." Braenyard - some Absent Friends are more equal than others _ : "I've got a book for Caroline, 'The Photosynthetic ..." Cheri: "That biopic that came out about Teddy Kennedy that ..." Judge Punchy: "Apparently Scott Pressler and Dan Bongino have app ..." NaCly Dog: "Deplorable Jay Guevara As Ambassador to Japan, ..." Recent Entries Quick Hits The Regime Vomits Up Two Eleventh Hour Hits on RFKJr. and Tulsi Gabbard "Star" of Fake Captain America Movie: I Don't Think That Captain America Should Represent America, But Instead Good Things Like Truth and Integrity Former CNN Thumb Chris Cillizza: I'm Totally Surprised That Trump Was Right About Covid Origins and Anthony Fauci Wrong; It Just Never Occurred to Me That the President of the United States Might Have Access to Secret Information I Didn't Have More Karoline Leavitt: It's Nice of You to Suddenly Care About the Price of Eggs, But the Increase Happened While the President You Corruptly Covered for Was "Sleeping Upstairs in the Residence" Karoline Leavitt's First Press Briefing Features a Roll Call of the Criminal Aliens The Democrats Protected for Decades and Who Trump Has Now Arrested Sean Duffy Confirmed as Secretary of Transportation Sean Duffy Confirmed as Secretary of Transportation; Karoline Leavitt's Inaugural Press Briefing Features a Slideshow of Now-Arrested Criminal Aliens and Their Crimes Jm J. Acosta Flounces Off CNN, Suggesting That CNN Is "Bowing to a Tyrant" for Shitcanning Him The Morning Rant: Minimalist Edition Search Search this site: Polls! Polls! Polls! Frequently Asked Questions What is the Deal with the Cowbell? Why is the Ace of Spades called "the Death Card"? The (Almost) Complete Paul Anka Integrity Kick Primary Document: The Audio Paul Anka Haiku Contest Announcement Integrity SAT's: Entrance Exam for Paul Anka's Band AllahPundit's Paul Anka 45's Collection AnkaPundit: Paul Anka Takes Over the Site for a Weekend (Continues through to Monday's postings) George Bush Slices Don Rumsfeld Like an Fckin' Hammer Top Top Tens Democratic Forays into Erotica New Shows On Gore's DNC/MTV Network Nicknames for Potatoes, By People Who Really* Hate Potatoes Star Wars Euphemisms for Self-Abuse Signs You're at an Iraqi "Wedding Party" Signs Your Clown Has Gone Bad Signs That You, Geroge Michael, Should Probably Just Give It Up Signs of Hip-Hop Influence on John Kerry NYT Headlines Spinning Bush's Jobs Boom Things People Are More Likely to Say Than "Did You Hear What Al Franken Said Yesterday?" Signs that Paul Krugman Has Lost His Frickin' Mind All-Time Best NBA Players, According to Senator Robert Byrd Other Bad Things About the Jews, According to the Koran Signs That David Letterman Just Doesn't Care Anymore Examples of Bob Kerrey's Insufferable Racial Jackassery Signs Andy Rooney Is Going Senile Other Judgments Dick Clarke Made About Condi Rice Based on Her Appearance Collective Names for Groups of People John Kerry's Other Vietnam Super-Pets Cool Things About the XM8 Assault Rifle Media-Approved Facts About the Democrat Spy Changes to Make Christianity More "Inclusive" Secret John Kerry Senatorial Accomplishments John Edwards Campaign Excuses John Kerry Pick-Up Lines Changes Liberal Senator George Michell Will Make at Disney Torments in Dog-Hell Greatest Hitjobs The Ace of Spades HQ Sex-for-Money Skankathon A D&D Guide to the Democratic Candidates Margaret Cho: Just Not Funny More Margaret Cho Abuse Margaret Cho: Still Not Funny Iraqi Prisoner Claims He Was Raped... By Woman Wonkette Announces "Morning Zoo" Format John Kerry's "Plan" Causes Surrender of Moqtada al-Sadr's Militia World Muslim Leaders Apologize for Nick Berg's Beheading Michael Moore Goes on Lunchtime Manhattan Death-Spree Milestone: Oliver Willis Posts 400th "Fake News Article" Referencing Britney Spears Liberal Economists Rue a "New Decade of Greed" Artificial Insouciance: Maureen Dowd's Word Processor Revolts Against Her Numbing Imbecility Intelligence Officials Eye Blogs for Tips They Done Found Us Out, Cletus: Intrepid Internet Detective Figures Out Our Master Plan Shock: Josh Marshall Almost Mentions Sarin Discovery in Iraq Leather-Clad Biker Freaks Terrorize Australian Town When Clinton Was President, Torture Was Cool What Wonkette Means When She Explains What Tina Brown Means Wonkette's Stand-Up Act Wankette HQ Gay-Rumors Du Jour Here's What's Bugging Me: Goose and Slider My Own Micah Wright Style Confession of Dishonesty Outraged "Conservatives" React to the FMA An On-Line Impression of Dennis Miller Having Sex with a Kodiak Bear The Story the Rightwing Media Refuses to Report! Our Lunch with David "Glengarry Glen Ross" Mamet The House of Love: Paul Krugman A Michael Moore Mystery (TM) The Dowd-O-Matic! Liberal Consistency and Other Myths Kepler's Laws of Liberal Media Bias John Kerry-- The Splunge! Candidate "Divisive" Politics & "Attacks on Patriotism" (very long) The Donkey ("The Raven" parody) Syndicate this site (XML) Powered by Movable Type 2.64