clean_data

Removes outliers from numeric data using the Median Absolute Deviation (MAD) method.
Outliers are replaced with NA values.

A robust implementation of Topolow algorithm. It embeds objects into a low-dimensional Euclidean space from a matrix of pairwise dissimilarities, even when the data do not satisfy metric or Euclidean axioms. The package is particularly well-suited for sparse, incomplete, and censored (thresholded) datasets such as antigenic relationships. The core is a physics-inspired, gradient-free optimization framework that models objects as particles in a physical system, where observed dissimilarities define spring rest lengths and unobserved pairs exert repulsive forces. The package also provides functions specific to antigenic mapping to transform cross-reactivity and binding affinity measurements into accurate spatial representations in a phenotype space.
Key features include:
* Robust Embedding from Sparse Data: Effectively creates complete and consistent maps (in optimal dimensions) even with high proportions of missing data (e.g., >95%).
* Physics-Inspired Optimization: Models objects (e.g., antigens, landmarks) as particles connected by springs (for measured dissimilarities) and subject to repulsive forces (for missing dissimilarities), and simulates the physical system using laws of mechanics, reducing the need for complex gradient computations.
* Automatic Dimensionality Detection: Employs a likelihood-based approach to determine the optimal number of dimensions for the embedding/map, avoiding distortions common in methods with fixed low dimensions.
* Noise and Bias Reduction: Naturally mitigates experimental noise and bias through its network-based, error-dampening mechanism.
* Antigenic Velocity Calculation (for antigenic data): Introduces and quantifies "antigenic velocity," a vector that describes the rate and direction of antigenic drift for each pathogen isolate. This can help identify cluster transitions and potential lineage replacements.
* Broad Applicability: Analyzes data from various objects that their dissimilarity may be of interest, ranging from complex biological measurements such as continuous and relational phenotypes, antibody-antigen interactions, and protein folding to abstract concepts, such as customer perception of different brands.
Methods are described in the context of bioinformatics applications in Arhami and Rohani (2025a) <doi:10.1093/bioinformatics/btaf372>, and mathematical proofs and Euclidean embedding details are in Arhami and Rohani (2025b) <doi:10.48550/arXiv.2508.01733>.

Omid Arhami

topolow

Force-Directed Euclidean Embedding of Dissimilarity Data

clean_data function

<dl><dt>x</dt>
<dd>Numeric vector to clean.</dd>
<dt>k</dt>
<dd>Numeric threshold for outlier detection (default: 3).</dd>
<dt>take_log</dt>
<dd>Logical. Deprecated parameter. Log transformation should be done before calling this function.</dd></dl>

Arguments

Clean Data by Removing MAD-based Outliers — clean_data

<dl>

<dt>x</dt>
<dd>Numeric vector to clean.</dd>


<dt>k</dt>
<dd>Numeric threshold for outlier detection (default: 3).</dd>


<dt>take_log</dt>
<dd>Logical. Deprecated parameter. Log transformation should be done before calling this function.</dd>

</dl>

clean_data: Clean Data by Removing MAD-based Outliers

Description

Usage

Value

Arguments

See Also

Examples