Learning from heterogeneous representations is often reduced to feature concatenation, erasing which representation produced each error. We propose residual algebra, in which each representation retains its coordinate system and owns its unresolved residual until an explicit aggregation boundary. Fold instantiates representations as point-in-time conditional-mean fields on 10x10 rank grids, and FPRC-PQ composes them through relax-aggregate-close: each field first fits a correction to its own residual, corrected fields then meet at a fixed mean, and a shared learner closes only the aggregate's fresh residual. We formalize aggregation as a quotient by the zero-sum redistribution kernel, characterizing legal post-aggregation operators as those constant on its cosets. The resulting composition separates representation, local residual estimation, and residual-of-residual estimation, with population variance reduction and first-order coupled-path mean orthogonality. Rumination-B and Rumination-H extend the algebra with quotient-legal finite correction and feedback. On 3.67M Chinese A-share stock-day observations (2023-2026) under a frozen point-in-time protocol, FPRC-PQ raises net-of-cost return from 13.52% to 19.10% and Sharpe from 1.42 to 2.09, outperforming matched-capacity, unified-residual, identity-free two-stage, and pairwise-only controls. The gain is thus attributable to explicit residual ownership and composition rather than additional features or trees.
Ruben Wiedemann, Antoine Jacquier, Lukas Gononcs.LG
Enforcing functional inequality constraints such as monotonicity and convexity in neural networks is a fundamental challenge in many industrial and scientific applications. Classical one-sided penalty methods, along with primal-dual methods gated by complementary slackness, provide constraint gradients only at violated locations, resulting in fragile satisfaction. Architectures that guarantee feasibility by construction, on the other hand, remain largely limited to elementary cases and impose additional inductive biases. We introduce neural slack variables, a deep learning native primal-side approach that converts constraint enforcement into a regression problem by coupling the primary network with a jointly learned auxiliary network. The auxiliary network serves as a valid target for the primary network's constraint quantities, inducing feasibility and regularity. Neural slack variables achieve zero measured violations on dense-grid monotonicity and convexity test cases, where penalty and primal-dual baselines leave residual violations, and enable arbitrage-free learning of volatility surfaces, an open industrial challenge in quantitative finance.