WiFlow: Estimating Optical Flow using WiFi Channel State Information

Knowing where and how fast objects are moving within a scene is important across various domains. Usually, cameras are used to capture the data necessary for this task, but adding cameras often raises privacy concerns, and the quality of captured frames is heavily influenced by lighting conditions. In this work, we explore using WiFi channel state information (CSI) instead of camera frames for optical flow estimation. We propose WiFlow, a CSI based flow estimator, a preprocessor evaluation for CSI, and three model architectures that offer different trade-offs between accuracy and complexity. Further, we create the first dataset for training and evaluating CSI-based optical flow estimators, and our experiments provide insights into key design elements for this task. Code and data are available at https://visinf.github.io/wiflow.

Seeing Through WiFi: Lightweight Human Pose Estimation with Dynamic Kernel Attention

WiFi-based human pose estimation (HPE) enables the detection and interpretation of human body positions and movements without the need for wearable devices while preserving individual privacy concerns. Implementing this solution requires enhancing model performance and maintaining efficiency, especially on resource-constrained devices. This paper introduces a novel framework, WiLHPE, for lightweight and efficient human pose estimation using WiFi CSI signals. Empowered by a camera-based model during training, WiLHPE processes raw WiFi signals directly to estimate human poses in the testing phase. It employs a novel neural network architecture to dynamically learn convolutional kernels and apply attention mechanisms across channel and frequency spaces. This innovative method diversifies the kernels to improve the recognition capabilities of WiFi signals without adding complexity, ensuring efficiency. Additionally, the Tree-Structured Parzen Estimator algorithm is employed to optimize the critical hyperparameters of the neural network efficiently, minimizing the time required for optimal hyperparameter search compared to heuristic methods. Results from experiments on both the MM-Fi and WiPose datasets highlight the superiority of WiLHPE over state-of-the-art approaches, achieving 85.96% and 94.27% at PCK50, respectively, with minimal computational overhead. Notably, WiLHPE performs impressively even under challenging conditions, maintaining around 80% at PCK50 under AWGN noise with an error variance of 0.5.

RePos: Relative-to-Absolute Pose Factorization for Cross-Environment WiFi-Based 3D Human Pose Estimation

Device-free 3D human pose estimation from commodity WiFi Channel State Information (CSI) enables human sensing that preserves privacy and tolerates poor illumination, but its deployment is limited by poor generalization across environments. Unlike images, CSI measurements have no spatially localized correspondence to body parts and are heavily affected by multipath propagation. Consequently, models that regress absolute poses entangle body structure with location cues specific to each environment. Within a single environment this coupling is not problematic: RePos-D, a direct model that regresses the absolute pose, already achieves the best reported accuracy on Person-in-WiFi-3D, a 3.4% gain over the previous best WiFi method, DT-Pose. Across environments, however, the same model overfits position and degrades sharply. We therefore propose RePos, a factorized framework that separates root-relative pose estimation from root localization. By shielding the structure branch from absolute position, RePos learns robust pose representations. Specifically, it groups CSI features into latent tokens organized by body part that a skeleton-guided module refines into the pose, while a separate network estimates the root position from CSI amplitude through a differentiable spatial decomposition. Under the strict MM-Fi cross-environment protocol, RePos reduces the mean per-joint position error (MPJPE) by 10-21% over existing WiFi methods. The improvement is consistent across activity protocols, holds when each environment is held out in turn, and survives few-shot transfer without data leakage. Further analysis shows that the relative pose predictions remain largely independent of position, whereas root localization remains dependent on the environment.