Monday, 12 March 2012

Information capacity and information compression

When the advice accommodation of a accumulator arrangement or a advice approach is presented in $.25 or $.25 per second, this generally refers to bifold digits, which is a computer accouterments accommodation to abundance bifold cipher (0 or 1, up or down, accepted or not, etc). Advice accommodation of a accumulator arrangement is alone an high apprenticed to the absolute abundance of advice stored therein. If the two accessible ethics of one bit of accumulator are not appropriately likely, that bit of accumulator will accommodate beneath than one bit of information. Indeed, if the bulk is absolutely predictable, again the account of that bulk will accommodate no advice at all (zero entropic bits, because no resolution of ambiguity and accordingly no information). If a computer book that uses n $.25 of accumulator contains alone m < n $.25 of information, again that advice can in assumption be encoded in about m bits, at atomic on the average. This assumption is the base of abstracts compression technology. Using an analogy, the accouterments bifold digits accredit to the bulk of accumulator amplitude accessible (like the cardinal of buckets accessible to abundance things), and the advice agreeable the filling, which comes in altered levels of granularity (fine or coarse, that is, aeroembolism or uncompressed information). Back the granularity is bigger (when advice is added compressed), the aforementioned brazier can authority more.

For example, it is estimated that the accumulated abstruse accommodation of the apple to abundance advice provides 1,300 exabytes of accouterments digits in 2007. However, back this accumulator amplitude is abounding and the agnate agreeable is optimally compressed, this alone represents 295 exabytes of information5. Back optimally compressed, the consistent accustomed accommodation approaches Shannon advice or advice entropy.

No comments:

Post a Comment