Portrait of Anatoly Vitold Stankyavichyus
Information theory · Quantitative research

Anatoly Vitold Stankyavichyus

Senior Data Scientist — varentropy, time-series modeling, and tail-risk measurement.

01

About the website

This site is dedicated to the theory, computation, and applications of varentropy.
Varentropy is the variance of surprisal: it measures how much the information content −log f(X) changes from one observation to another. This makes it a natural statistic for comparing distributional shape, concentration, and rare-outcome severity. It is often more practical than tail-index estimation, because it avoids delicate tail-threshold choices, and it can remain meaningful when ordinary moments are unstable or infinite. With geometric assumptions, varentropy also gives testable structure: in one dimension, every log-concave distribution has varentropy at most 1, so a well-estimated value far above 1 is evidence against log-concavity.

You might be asking what's wrong with good old variance as a measure of risk? For starters, variance need not exist for fat-tailed distributions, because it needs a finite second moment.

Measuring and understanding the fat-tailedness of a process, or its distributional shape, matters for understanding how much of the risk/loss comes from a few rare observations under a given generating process. Under a subexponential law, the bulk of a large loss typically comes from a handful of extreme observations (the catastrophe principle), and the more pronounced this concentration, the less a finite sample reveals: for a well-behaved shape such as a Gaussian, even a small sample pins down the likely range of losses, whereas for an α-stable law with small α one should assume the most severe outcomes have yet to be seen.

In terms of Lévy processes, it's the difference between losses coming from the Brownian-motion part and losses coming from a jump. Variance only tells us the scale of losses, not where they come from.

In a nutshell, the importance of shape comes from the concentration of losses, and varentropy — together with mild geometric assumptions such as unimodality and monotone tails — is well suited to measuring it.

Varentropy demo : Student-t
\[ V(X)\;=\;\operatorname{Var}\!\big(-\log f(X)\big) \]
Student t ν = 2
Scale σ = 1

density  f(x)

density of surprisal −log f(X)

H(X) = 1.960 V(X) = 1.598 √V = 1.264
\[ V(X)=\Big(\tfrac{\nu+1}{2}\Big)^{2}\big[\,\psi'(\tfrac{\nu}{2})-\psi'(\tfrac{\nu+1}{2})\,\big] \]
ν:  V ∼ 1/ν² → ∞ as ν → 0⁺  ·  = π²/3 at ν = 1 (Cauchy)
σ:  H(σX) = H(X) + log σ (entropy shifts)  ·  V(σX) = V(X) (scale‑invariant)
02

About me

Anatoly Vitold Stankyavichyus is a Senior Data Scientist working in the utilities sector specializing in load research, time-series modeling, and large-scale energy data analytics. At PSEG Long Island, he has developed and productionized models for load disaggregation, weather normalization, demand response performance assessment, rate design and customer load profiling at scale. His work combines advanced statistical methods with modern data engineering to deliver practical insights across millions of customers.

M.S. in Applied Mathematics and Statistics, Stony Brook University.

03

Preprints

Varentropy: Overview, Computational Routes, and Structural Decomposition
A compact guide to varentropy: computational routes, finiteness criteria, rearrangement invariance, and a Fisher/tangent decomposition yielding lower bounds.
Varentropy of Stable Laws: A Constructive Formula at Rational Index
Constructive rational-α formula for stable-law varentropy via Fox–H/hypergeometric kernels, D-algebraic residual periods, and stable-CLT convergence.
The Price of Jumpiness: Varentropy, Magnitude-Information Profiles, and Finite-Horizon Floor-Breach Risk in Kelly Allocation
Uses downside varentropy and loss-side magnitude-information profiles to diagnose finite-horizon floor-breach risk in Kelly allocation.
04

Elsewhere