Create more documentation in IPFS about BloomFilter

[RubenKelevra]

There need to be more documentation on the BloomFilter option in IPFS. This ticket is about tracking this process.

@Luflosi wrote

I found the Datastore.BloomFilterSize option, which sounds like it has the potential to speed up pinning operations but I couldn't find any documentation on what it actually does. > Do you know?

Originally posted by @Luflosi in #42 (comment)

[RubenKelevra]

@RubenKelevra wrote

@Luflosi wrote

I found the Datastore.BloomFilterSize option, which sounds like it has the potential to speed up pinning operations but I couldn't find any documentation on what it actually does. Do you know?

Well, it's an interesting feature, but you need to tune it depending on the amount of CIDs you store. It replaces a "let's check if we got that data already" with a "let's have a calculation which gives us with 99.xx% certainty the same result".

It's definitely faster, but rarely used. That's why I stay away from it in my daily IPFS usage.

I don't know what happens when we cannot deliver 0.xx percent of the blocks, because their checksums was too similar, but I guess it wouldn't be pretty.