Sheaf-theoretic Signal Processing on Graphs: Spectral Theory, Filtering, and Sampling

Modern sensing, communication, and learning systems generate heterogeneous network signals, with local data differing in dimension, modality, and geometric structure. Processing such data requires a mathematical framework capable of simultaneously modeling heterogeneous local signal spaces and the transformations relating them. Network sheaves provide such a framework by associating local vector spaces with network entities and linear restriction maps with their interactions. This is the first paper to develop a unified sheaf signal processing (SSP) framework on network sheaves, extending the fundamental operations of signal processing, namely spectral analysis, filtering, and sampling, to heterogeneous local spaces. Unlike graph and topological signal processing, where signals are modeled over a common vector space, SSP jointly models heterogeneous local signal spaces and the linear transformations relating neighboring spaces through restriction maps. We define the Sheaf Fourier Transform (SFT), whose frequencies quantify signal inconsistency induced by the network topology, the restriction maps, and the local geometry. Building on this representation, we develop polynomial sheaf filters and formulate sampling as the joint selection of network nodes and intra-node components. We derive perfect recovery conditions for bandlimited sheaf signals and propose a greedy sampling-set design algorithm. To incorporate application-dependent signal models, including different bases, dictionaries, and learned embeddings, we introduce representation sheaves and characterize the natural transformations that preserve spectral properties and guarantee interoperability across representations. Experiments on synthetic, motion-capture, and financial datasets validate the proposed framework and demonstrate consistent improvements over canonical graph signal processing baselines.

Average Distance Approximation for Static Large Graphs

Calculating average distances in large-scale networks is computationally intensive and constrained by limited main memory, posing a significant challenge in graph analytics. This study explores and evaluates two primary approaches for estimating average distances: a graph sampling-based method (Random Walk) and landmark-based methods, including the Size Estimation Framework (SEF) and the Eppstein-Wang (EW) algorithm. Random Walk was found to be unreliable for small sample sizes and computationally expensive for larger ones, requiring at least 15% of nodes for accuracy. Landmark-based approaches, leveraging probabilistic data structures like HyperLogLog for memory-efficient neighbor exploration, demonstrated superior performance. Among these, the SEF algorithm offers better memory efficiency, while the EW algorithm achieves higher accuracy with lower computation time. Experiments on static, undirected, and unweighted graphs (both unipartite and bipartite) revealed that the EW algorithm produced results with an error margin as low as 0.02%. Additionally, a subset of 100 randomly selected nodes was sufficient for accurate estimations in most large graphs. The findings indicate that the EW algorithm provides a practical and scalable solution for average distance estimation, with higher reliability on unipartite graphs compared to bipartite graphs.

FeLoG: Scalable and Efficient Distributed Graph Embedding with Feedback Loop Mechanism

Graph embedding maps graph nodes into low-dimensional vectors to support applications such as recommendation, fraud detection, and graph-based retrieval-augmented generation (GraphRAG). As graphs scale to billions of edges, scalable and efficient graph embedding has become increasingly important. Existing frameworks commonly adopt a sampling-training paradigm, in which mini-batches are constructed by sampling nodes and their neighbors. However, sampling is typically decoupled from evolving embedding quality, causing redundant exploration of well-trained regions while under-sampling undertrained nodes. At the system level, such decoupling further leads to excessive communication, serialized execution, and low resource utilization in distributed environments. We present FeLoG, a feedback loop-driven system for scalable distributed graph embedding. (1) FeLoG introduces feedback-coupled sampling and training, dynamically prioritizing undertrained nodes according to real-time embedding-quality feedback, thereby reducing redundant computation and accelerating convergence. (2) It employs activity-aware communication that compresses frequently occurring node sequences to reduce intra-machine PCIe traffic and selectively synchronizes frequently updated embeddings to reduce inter-machine communication. (3) It adopts a round-interleaved pipeline that overlaps next-round sampling with current-round training to improve CPU-GPU utilization. Experiments against six state-of-the-art baselines on large-scale graphs show that FeLoG achieves an average speedup of 27.9x, reduces communication cost by more than 53.1%, and sustains over 80% CPU-GPU utilization.