Section 2.6.1.0 - Introductory Writeups
Section 2.6.1.0.1 - Basic Writeup - Wikipedia - Information Theory
Section 2.6.1.0.2 - Detailed Writeup - Gray - Entropy and Information Theory
Section 2.6.1.0.3 - Video - Mathematical Monk - Information Theory
Section 2.6.1.1 - Entropy
Section 2.6.1.2 - Differential Entropy
Section 2.6.1.3 - Conditional entropy
Section 2.6.1.4 - Joint entropy
Section 2.6.1.5 - Mutual information
Section 2.6.1.6 - Conditional mutual information
Section 2.6.1.7 - Relative entropy
Section 2.6.1.8 - Entropy rate
Section 2.6.1.9 - Asymptotic equipartition property
Section 2.6.1.10 - Rate–distortion theory
Section 2.6.1.11 - Shannon's source coding theorem
Section 2.6.1.12 - Channel capacity
Section 2.6.1.13 - Noisy-channel coding theorem
Section 2.6.1.14 - Shannon–Hartley theorem
Section 2.6.1.15 - Quantities of information
Section 2.6.1.15.1 - Entropy of an information source
Section 2.6.1.15.2 - Joint entropy
Section 2.6.1.15.3 - Conditional entropy (equivocation)
Section 2.6.1.15.4 - Mutual information (transinformation)
Section 2.6.1.15.5 - Kullback–Leibler divergence (information gain)
Section 2.6.1.15.6 - Rényi entropy
Section 2.6.1.15.7 - Differential entropy
Section 2.6.1.15.8 - Conditional mutual information.
Section 2.6.1.16 - Concepts
Section 2.6.1.16 - Ban (Unit)
Section 2.6.1.16.2 - Channel capacity
Section 2.6.1.16.3 - Communication channel
Section 2.6.1.16.4 - Communication source
Section 2.6.1.16.5 - Conditional entropy
Section 2.6.1.16.6 - Covert channel
Section 2.6.1.16.7 - Decoder
Section 2.6.1.16.8 - Differential entropy
Section 2.6.1.16.9 - Encoder
Section 2.6.1.16.10 - Fungible information
Section 2.6.1.16.11 - Information entropy
Section 2.6.1.16.12 - Joint entropy
Section 2.6.1.16.13 - Kullback–Leibler divergence
Section 2.6.1.16.14 - Mutual information
Section 2.6.1.16.15 - Pointwise mutual information (PMI)
Section 2.6.1.16.16 - Receiver (information theory)
Section 2.6.1.16.17 - Redundancy
Section 2.6.1.16.18 - Rényi entropy
Section 2.6.1.16.19 - Self-information
Section 2.6.1.16.20 - Unicity distance
Section 2.6.1.16.21 - Variety
Section 2.6.1.16.22 - Hamming distance
Section 2.6.1.17 - Theory
Section 2.6.1.17.1 - Coding theory
Section 2.6.1.17.2 - Detection theory
Section 2.6.1.17.3 - Estimation theory
Section 2.6.1.17.4 - Fisher information
Section 2.6.1.17.5 - Information algebra
Section 2.6.1.17.6 - Information asymmetry
Section 2.6.1.17.7 - Information field theory
Section 2.6.1.17.8 - Information geometry
Section 2.6.1.17.9 - Information theory and measure theory
Section 2.6.1.17.10 - Kolmogorov complexity
Section 2.6.1.17.11 - List of unsolved problems in information theory
Section 2.6.1.17.12 - Logic of information
Section 2.6.1.17.13 - Network coding
Section 2.6.1.17.14 - Philosophy of information
Section 2.6.1.17.15 - Quantum information science
Section 2.6.1.17.16 - Source coding
Section 2.6.2.0 - Basic Writeup - Wikipedia - Information Retrieval
Section 2.6.2.1 - Model Types
Section 2.6.2.1.0 - Introductory Writeups
Section 2.6.2.1.0.1 - Detailed Writeups
Section 2.6.2.1.0.1.1 - Part 1 - Furh - Models in Information Retrieval
Section 2.6.2.1.0.1.2 - Part 2 - Chen - Models for Information Retrieval
Section 2.6.2.1.1 - First (and Second) Dimensions
Section 2.6.2.1.1.0 - Basic Writeup - Wikipedia - First Dimension: Mathematical Basis
Section 2.6.2.1.1.1 - First Dimension: Set-theoretic models
Section 2.6.2.1.1.1.0 - Basic Writeup - Slide Player - Set-theoretic models
Section 2.6.2.1.1.1.1 - Second Dimension: Without Term Interdependencies
Section 2.6.2.1.1.1.1.1 - Standard Boolean model
Section 2.6.2.1.1.1.1.2 - Extended Boolean model
Section 2.6.2.1.1.1.2 - Second Dimension: With Transcendant Term Interdependencies
Section 2.6.2.1.1.1.2.1 - Fuzzy retrieval
Section 2.6.2.1.1.2 - First Dimension: Algebraic models
Section 2.6.2.1.1.2.0 - Basic Writeup - Pannu,James,Bird - Comparison of Information Retrieval Models: Algebraic models
Section 2.6.2.1.1.2.1 - Second Dimension: Without Term Interdependencies
Section 2.6.2.1.1.2.1.1 - Vector space model
Section 2.6.2.1.1.2.1.2 - Extended Boolean model
Section 2.6.2.1.1.2.2 - Second Dimension: With Imminent Term Interdependencies
Section 2.6.2.1.1.2.2.1 - Generalized vector space model
Section 2.6.2.1.1.2.2.2 - Latent semantic indexing
Section 2.6.2.1.1.2.2.3 - Latent semantic analysis
Section 2.6.2.1.1.2.2.4 - Spread Activation Neuronal Network
Section 2.6.2.1.1.2.3 - Second Dimension: With Transcendant Term Interdependencies
Section 2.6.2.1.1.2.3.1 - Topic-based (Enhanced) Vector Space Model
Section 2.6.2.1.1.2.3.2 - Feedforward Neural Networks
Section 2.6.2.1.1.3 - First Dimension: Probabilistic models
Section 2.6.2.1.1.3.0 - Basic Writeup - Stanford - Probabilistic Information Retrieval
Section 2.6.2.1.1.3.1 - Second Dimension: Without Term Interdependencies
Section 2.6.2.1.1.3.1.1 - Binary Independence Model
Section 2.6.2.1.1.3.1.2 - Language models
Section 2.6.2.1.1.3.1.3 - Inference Network
Section 2.6.2.1.1.3.1.4 - Bayesian Network
Section 2.6.2.1.1.3.1.5 - Probabilistic relevance model
Section 2.6.2.1.1.3.1.5.0 - Basic Writeup - Probabilistic relevance model
Section 2.6.2.1.1.3.1.5.1 - Okapi (BM25)
Section 2.6.2.1.1.3.1.6 - Uncertain inference
Section 2.6.2.1.1.3.2 - Second Dimension: With Term Interdependencies
Section 2.6.2.1.1.3.2.1 - Divergence-from-randomness model
Section 2.6.2.1.1.3.2.2 - Latent Dirichlet allocation
Section 2.6.2.1.1.4 - First Dimension: Feature-based (Learning to Rank) retrieval models
Section 2.6.2.2 - Evaluation Metrics
Section 2.6.2.2.0 - Basic Writeup - Wikipedia - Evaluation Metrics
Section 2.6.2.2.1 - Online metrics
Section 2.6.2.2.1.1 - Session abandonment rate
Section 2.6.2.2.1.2 - Click-through rate
Section 2.6.2.2.1.3 - Session success rate
Section 2.6.2.2.1.4 - Zero result rate
Section 2.6.2.2.2 - Offline metrics
Section 2.6.2.2.2.1 - Precision and Recall
Section 2.6.2.2.2.2 - Fall-out
Section 2.6.2.2.2.3 - F-score / F-measure
Section 2.6.2.2.2.4 - Average precision
Section 2.6.2.2.2.5 - Precision at K
Section 2.6.2.2.2.6 - R-Precision
Section 2.6.2.2.2.7 - Mean average precision
Section 2.6.2.2.2.8 - Discounted cumulative gain
Section 2.6.2.2.2.9 - Mean reciprocal rank
Section 2.6.2.2.2.10 - Spearman's rank correlation coefficient
Section 2.6.2.2.2.11 - bpref
Section 2.6.2.2.2.12 - GMAP - geometric mean of (per-topic) average precision
Section 2.6.2.2.2.13 - Maximal Marginal Relevance (MMR)
Section 2.6.2.2.2.14 - Measures of both relevance and credibility (for fake news in search results)
Section 2.6.2.2.2.15 - Sensitivity
Section 2.6.2.2.2.16 - Specificity
Section 2.6.2.2.2.17 - Positive Predictive Value
Section 2.6.2.2.2.18 - Negative Predictive Value
Section 2.6.2.2.2.19 - Type 1 and Type 2 Errors
Section 2.6.2.2.2.20 - False Discovery Rate
Section 2.6.2.2.2.21 - False Omission Rate
Section 2.6.2.2.2.22 - Accuracy
Section 2.6.2.2.2.23 - Matthews Corellation Coefficient
Section 2.6.2.2.2.24 - Informedness
Section 2.6.2.2.2.25 - Visualization
Section 2.6.2.2.2.16.1 - Graphs which chart precision on one axis and recall on the other
Section 2.6.2.2.2.25.2 - Histograms of average precision over various topics
Section 2.6.2.2.2.25.3 - Receiver operating characteristic (ROC curve)
Section 2.6.2.2.2.25.4 - Confusion (Error) matrix
Section 2.6.2.3 - Other Topics
Section 2.6.2.3.1 - Adversarial information retrieval
Section 2.6.2.3.2 - Collaborative information seeking
Section 2.6.2.3.3 - Controlled vocabulary
Section 2.6.2.3.4 - Cross-language information retrieval
Section 2.6.2.3.5 - Data mining
Section 2.6.2.3.6 - Human–computer information retrieval (HCIR)
Section 2.6.2.3.7 - Information extraction
Section 2.6.2.3.8 - Knowledge visualization
Section 2.6.2.3.9 - Multimedia information retrieval
Section 2.6.2.3.10 - Personal information management
Section 2.6.2.3.11 - Relevance (information retrieval)
Section 2.6.2.3.12 - Relevance feedback
Section 2.6.2.3.13 - Rocchio classification
Section 2.6.2.3.14 - Search index
Section 2.6.2.3.15 - Social information seeking
Section 2.6.2.3.16 - Subject indexing
Section 2.6.2.3.17 - Temporal information retrieval
Section 2.6.2.3.18 - tf-idf
Section 2.6.2.3.19 - XML retrieval
Section 2.6.2.3.20 - Web mining