The filter is known as the "trigger". The trigger has several levels, so that the data rate is reduced by an order of magnitude or more at each level. The lowest levels are done in hardware for speed. The upper levels are in software for flexibility.<p>Designing the trigger is extremely complex, since the various detectors within each experiment have greatly varying response time. Only data from fast detectors is available for the low level trigger.<p>In addition, the speed of light is a real barrier for the lower levels of the trigger; by the time the debris from a collisions reach the outer reaches of the experiment (this is usually where the muon chamber is), there have already been an additional collision at the center.<p>(The speed of light is about 1 ft/nanosecond, the radius of the muon chamber in CMS is about 25 ft, and the time between bunch crossings is about 25 nanoseconds.)<p>The design of the trigger is a very important and often contentious process. A bad trigger will throw out important physics events, and trade-offs can favor one physics search (e.g. the Higgs) over another (e.g. supersymmetry).
Alright; I'm confused.<p>First they say that they "generate around 1 petabyte of data per second"<p>Then they say "ATLAS produces up to 320M bytes per second, followed by CMS with 220M Bps. The data from ALICE amounts to 100M Bps and LHCb produces 50M Bps." only that sums up to 690M Bps ... definitely not 1 petabyte per second. (That is, assuming that 1M Bps means 1 million bytes per second, or just under 1 megabytes per second.)<p>And then, later on, they talk about a different mode in which "more data is produced by the four experiments, about 1.25G Bps in total." which is still not 1 petabyte per second.<p>What's going on?
There was a very good and very detailed talk given by Tony Cass from CERN at the LISA 2010 conference. The talk gives a much more in-depth look at the environment at the LHC. The link below has the audio, video and slides from the talk. Look for "The LHC Computing Challenge: Preparation, Reality, and Future Outlook"<p><a href="http://www.usenix.org/events/lisa10/tech/" rel="nofollow">http://www.usenix.org/events/lisa10/tech/</a>