Search arXiv⌕ Search

arXiv subjects

Alejandro Treny Ortega

Publications and source records attributed to Alejandro Treny Ortega.

1 recordsLinked to original sources

How much does the map of science depend on the embedding model?

Science maps describe relationships between papers. Text embedding models build these relationships by turning a paper's text into a list of numbers that gives it a position. Would another model give the same picture? I compare ten models using titles and abstracts of 500,000 publications from the OpenAlex bibliographic catalogue, published in 2000-2024 across 26 disciplines, including Medicine and Physics. Representing each discipline by its papers' average position produces similar arrangements across models, including when other papers are selected. Yet within a discipline and period, two models share, on average, only eight of the 25 papers closest to a given paper. Supplying titles alone also changes much of that list, with effects that vary between models. Models can also disagree about which discipline's papers are more spread out. One measure of spread compares angles between lines drawn from a common point to each paper's position. Moving that point can reverse which discipline appears more spread out, even when selecting other papers leaves the answer unchanged. The broad arrangement can remain similar while answers about nearby papers and differences between disciplines depend on the model, the text it receives and how its output is processed.

cs.DL↗