On the k-independence required by linear probing and minwise independence

Research output: Contribution to journalJournal articleResearchpeer-review

We show that linear probing requires 5-independent hash functions for expected constant-time performance, matching an upper bound of Pagh et al. [2009]. More precisely, we construct a random 4-independent hash function yielding expected logarithmic search time for certain keys. For (1 + ε)-approximate minwise independence, we show that Ω(lg1 ε)-independent hash functions are required, matching an upper bound of Indyk [2001]. We also show that the very fast 2-independent multiply-shift scheme of Dietzfelbinger [1996] fails badly in both applications.

Original languageEnglish
Article number8
JournalACM Transactions on Algorithms
Volume12
Issue number1
Number of pages27
ISSN1549-6325
DOIs
Publication statusPublished - 2016

    Research areas

  • k-Independent hashing, Linear probing, Minwise independence

ID: 160018732