Understanding the Moments of Tabulation Hashing via Chaoses

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Documents

  • Fulltext

    Final published version, 764 KB, PDF document

Simple tabulation hashing dates back to Zobrist in 1970 and is defined as follows: Each key is viewed as c characters from some alphabet Σ, we have c fully random hash functions h0,..., hc−1: Σ → {0,..., 2l − 1}, and a key x = (x0,..., xc−1) is hashed to (Equation presented) where ⊕ is the bitwise XOR operation. The previous results on tabulation hashing by Pǎtraşcu and Thorup [J.ACM'11] and by Aamand et al. [STOC'20] focused on proving Chernoff-style tail bounds on hash-based sums, e.g., the number keys hashing to a given value, for simple tabulation hashing, but their bounds do not cover the entire tail. Thus their results cannot bound moments. The paper Dahlgaard et al. [FOCS'15] provides a bound on the moments of certain hash-based sums, but their bound only holds for constant moments, and we need logarithmic moments. Chaoses are random variables of the form (Equation presented) where Xi are independent random variables. Chaoses are a well-studied concept from probability theory, and tight analysis has been proven in several instances, e.g., when the independent random variables are standard Gaussian variables and when the independent random variables have logarithmically convex tails. We notice that hash-based sums of simple tabulation hashing can be seen as a sum of chaoses that are not independent. This motivates us to use techniques from the theory of chaoses to analyze hash-based sums of simple tabulation hashing. In this paper, we obtain bounds for all the moments of hash-based sums for simple tabulation hashing which are tight up to constants depending only on c. In contrast with the previous attempts, our approach will mostly be analytical and does not employ intricate combinatorial arguments. The improved analysis of simple tabulation hashing allows us to obtain bounds for the moments of hash-based sums for the mixed tabulation hashing introduced by Dahlgaard et al. [FOCS'15]. With simple tabulation hashing, there are certain inputs for which the concentration is much worse than with fully random hashing. However, with mixed tabulation, we get logarithmic moment bounds that are only a constant factor worse than those with fully random hashing for any possible input. This is a strong addition to other powerful probabilistic properties of mixed tabulation hashing proved by Dahlgaard et al.

Original languageEnglish
Title of host publication49th EATCS International Conference on Automata, Languages, and Programming, ICALP 2022
EditorsMikolaj Bojanczyk, Emanuela Merelli, David P. Woodruff
PublisherSchloss Dagstuhl- Leibniz-Zentrum fur Informatik GmbH, Dagstuhl Publishing
Publication dateJul 2022
Pages1-19
Article number74
ISBN (Electronic)9783959772358
DOIs
Publication statusPublished - Jul 2022
Event49th EATCS International Conference on Automata, Languages, and Programming, ICALP 2022 - Paris, France
Duration: 4 Jul 20228 Jul 2022

Conference

Conference49th EATCS International Conference on Automata, Languages, and Programming, ICALP 2022
LandFrance
ByParis
Periode04/07/202208/07/2022
SponsorCNRS, Inria, Nomadic Lab, Université Paris Cité
SeriesLeibniz International Proceedings in Informatics, LIPIcs
Volume229
ISSN1868-8969

Bibliographical note

Publisher Copyright:
© Jakob Bæk Tejs Houen and Mikkel Thorup; licensed under Creative Commons License CC-BY 4.0

    Research areas

  • concentration bounds, hashing, moment bounds

Number of downloads are based on statistics from Google Scholar and www.ku.dk


No data available

ID: 314296202