Search arXivSearch

arXiv · 0907.2393

Multiscale Network Reduction Methodologies: Bistochastic and Disparity Filtering of Human Migration Flows between 3,000+ U. S. Counties

Abstract

To control for multiscale effects in networks, one can transform the matrix of (in general) weighted, directed internodal flows to bistochastic (doubly-stochastic) form, using the iterative proportional fitting (Sinkhorn-Knopp) procedure, which alternatively scales row and column sums to all equal 1. The dominant entries in the bistochasticized table can then be employed for network reduction, using strong component hierarchical clustering. We illustrate various facets of this well-established, widely-applied two-stage algorithm with the 3, 107 x 3, 107 (asymmetric) 1995-2000 intercounty migration flow table for the United States. We compare the results obtained with ones using the disparity filter, for "extracting the "multiscale backbone of complex weighted networks", recently put forth by Serrano, Boguna and Vespignani (SBV) (Proc. Natl. Acad. Sci. 106 [2009], 6483), upon which we have briefly commented (Proc. Natl. Acad. Sci. 106 [2009], E66). The performance of the bistochastic filter appears to be superior-at least in this specific case-in two respects: (1) it requires far fewer links to complete a stongly-connected network backbone; and (2) it "belittles" small flows and nodes less-a principal desideratum of SBV-in the sense that the correlations of the nonzero raw flows are considerably weaker with the corresponding bistochastized links than with the significance levels yielded by the disparity filter. Additional comparative studies--as called for by SBV-of these two filtering procedures, in particular as regards their topological properties, should be of considerable interest. Relatedly, in its many geographic applications, the two-stage procedure has--with rare exceptions-clustered contiguous areas, often reconstructing traditional regions (islands, for example), even though no contiguity constraints, at all, are imposed beforehand.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Paul B. Slater. 2010-09-24. Multiscale Network Reduction Methodologies: Bistochastic and Disparity Filtering of Human Migration Flows between 3,000+ U. S. Counties. https://arxiv.org/abs/0907.2393

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Self-Reference in Large Language Models: The Introspection Threshold for Recursive Self-Improvement

The pursuit of self-evolving AI raises a critical question: when is autonomous self-improvement sustainable rather than degenerative? Drawing an analogy to von Neumann's complexity threshold for self-reproducing automata, we argue that sustainable recursive self-improvement in Large Language Models (LLMs) requires a functional analogue: introspection -- the system's capacity to simulate its own operations and target modifications. Grounded in Kleene's Second Recursion Theorem, we demonstrate the theoretical existence of such introspective programs. However, an empirical review reveals that while current LLMs exhibit quasi-introspection (e.g., partial metacognition), they fall short of true introspection due to structural bottlenecks: a lack of complete self-access, the feedforward nature of the Transformer, and computational class constraints that prevent fixed-point iteration. We conclude by outlining architectural paths to cross this complexity threshold and discussing the associated safety implications.

physics.soc-ph

Multilayer Analysis of the Global Trade Network

Global trade is more than a single network of aggregate flows. Beneath the observable exchange of products among economies lies a complex multilayer structure, formed by thousands of product-specific trade relationships that differ in their similarity, interdependence, and temporal evolution. Using the CEPII's BACI database, which records bilateral product-level trade flows between economies, we represent the global trade network from 1995 to 2024 as a temporal multilayer network, with economies as nodes and directed weighted trade flows as edges. To investigate product-level organisation and cross-layer similarity, temporal structural change, and the structural role of individual economies, we introduce a random-walk-based similarity measure that provides a unified framework for comparing weighted and directed trade layers. Our results show that the global trade network remains relatively stable over short periods but undergoes gradual structural change over longer timescales. We also find that similarity-based product communities only partially align with the official product taxonomy, indicating that products assigned to the same official category do not necessarily exhibit similar trade-network structures. Finally, we show that an economy's structural influence is not always determined by its trade volume. These results highlight the value of multilayer network analysis for revealing patterns in global trade that remain hidden at the aggregate level.

physics.soc-ph

Detectability limits of scaling laws

Power law scaling relations between size and output are central to quantitative theories of cities, organisms, and other complex systems. Competing theories predict scaling exponents that differ by small fractions, but there is no existing theory for verifying whether a given dataset can even distinguish exponents at the required resolution to address such discrepancies. Here we derive a resolution limit for scaling exponents, giving the smallest exponent difference that any method of analysis can detect. We find that the Hurst exponents governing the evolution of systems' sizes and deviations from the scaling law determine how long a record of growing systems must be before it can separate competing scaling theories. Empirical results suggest that many available data panels are insufficient for reliable scaling model selection.

physics.soc-ph