Skip to content
∂erivon
EngineeringOctober 4, 2026- 2 min read

Ask for a Laplacian, not every Hessian entry

Direct contractions compute the quantity a residual needs while retaining parameter gradients.

D
Derivon
Project notes

A Laplacian is the trace of a spatial Hessian. Building every Hessian entry is one way to compute that trace, but a supported model can propagate the contraction directly.

The one-layer identity

Δᵏf(x) = Σ_h c_h σ⁽²ᵏ⁾(w_h·x + β_h) ‖w_h‖²ᵏ

Activation derivative recurrences and weight norms give this specialized expression. The expression removes a nested differentiation graph; its arithmetic and input processing still have costs.

Deep networks have their own contract

The deep Laplacian path retains parameter gradients and has no fixed input-dimension ceiling. For fixed layer widths and depth, work and memory grow with input dimension. Deep repeated Laplacians may use exact support enumeration or a reported directional estimator.

Check a small case first

Our tutorial compares a direct Laplacian with an independent dense-Hessian trace, then verifies finite gradients into the weights.

Run the comparison · Read the numerical contract

#laplacian#autodiff#jax
D
Derivon
Project notes

Technical notes from the omnibias project, grounded in published source and numerical evidence.

Put closed-form derivatives in your inner loop

Send us one derivative bottleneck. We will benchmark a supported derivative path against your current implementation - on your problem sizes.

Or email info@derivon.ai