Search arXivSearch

arXiv subjects

Alex Kim

Publications and source records attributed to Alex Kim.

At least 19 recordsLinked to original sources

Financial Statement Analysis with Large Language Models

We investigate whether large language models (LLMs) can successfully perform financial statement analysis in a way similar to a professional human analyst. We provide standardized and anonymous financial statements to GPT4 and instruct the model to analyze them to determine the direction of firms' future earnings. Even without narrative or industry-specific information, the LLM outperforms financial analysts in its ability to predict earnings changes directionally. The LLM exhibits a relative advantage over human analysts in situations when the analysts tend to struggle. Furthermore, we find that the prediction accuracy of the LLM is on par with a narrowly trained state-of-the-art ML model. LLM prediction does not stem from its training memory. Instead, we find that the LLM generates useful narrative insights about a company's future performance. Lastly, our trading strategies based on GPT's predictions yield a higher Sharpe ratio and alphas than strategies based on other models. Our results suggest that LLMs may take a central role in analysis and decision-making.

q-fin.ST

DEBATE: Devil's Advocate-Based Assessment and Text Evaluation

As natural language generation (NLG) models have become prevalent, systematically assessing the quality of machine-generated texts has become increasingly important. Recent studies introduce LLM-based evaluators that operate as reference-free metrics, demonstrating their capability to adeptly handle novel tasks. However, these models generally rely on a single-agent approach, which, we argue, introduces an inherent limit to their performance. This is because there exist biases in LLM agent's responses, including preferences for certain text structure or content. In this work, we propose DEBATE, an NLG evaluation framework based on multi-agent scoring system augmented with a concept of Devil's Advocate. Within the framework, one agent is instructed to criticize other agents' arguments, potentially resolving the bias in LLM agent's answers. DEBATE substantially outperforms the previous state-of-the-art methods in two meta-evaluation benchmarks in NLG evaluation, SummEval and TopicalChat. We also show that the extensiveness of debates among agents and the persona of an agent can influence the performance of evaluators.

cs.CL

Detecting unresolved lensed SNe Ia in LSST using blended light curves

Strongly gravitationally lensed supernovae (LSNe) are promising probes for providing absolute distance measurements using gravitational-lens time delays. Spatially unresolved LSNe offer an opportunity to enhance the sample size for precision cosmology. We predict that there will be approximately three times as many unresolved as resolved LSNe Ia in the Legacy Survey of Space and Time (LSST) by the {\it Rubin} Observatory. In this article, we explore the feasibility of detecting unresolved LSNe Ia from a pool of preclassified SNe Ia light curves using the shape of the blended light curves with deep-learning techniques. We find that $\sim 30\%$ unresolved LSNe Ia can be detected with a simple 1D convolutional neural network (CNN) using well-sampled $rizy$-band light curves (with a false-positive rate of $\sim 3\%$). Even when the light curve is well observed in only a single band among $r$, $i$, and $z$, detection is still possible with false-positive rates ranging from $\sim 4$ to $7\%$ depending on the band. Furthermore, we demonstrate that these unresolved cases can be detected at an early stage using light curves up to $\sim20$ days from the first observation with well-controlled false-positive rates, providing ample opportunity to trigger follow-up observations. Additionally, we demonstrate the feasibility of time-delay estimations using solely LSST-like data of unresolved light curves, particularly for doubles, when excluding systems with low time delays and magnification ratios. However, the abundance of such systems among those unresolved in LSST poses a significant challenge. This approach holds potential utility for upcoming wide-field surveys, and overall results could significantly improve with enhanced cadence and depth in the future surveys.

astro-ph.IM

Automatic Creative Selection with Cross-Modal Matching

Application developers advertise their Apps by creating product pages with App images, and bidding on search terms. It is then crucial for App images to be highly relevant with the search terms. Solutions to this problem require an image-text matching model to predict the quality of the match between the chosen image and the search terms. In this work, we present a novel approach to matching an App image to search terms based on fine-tuning a pre-trained LXMERT model. We show that compared to the CLIP model and a baseline using a Transformer model for search terms, and a ResNet model for images, we significantly improve the matching accuracy. We evaluate our approach using two sets of labels: advertiser associated (image, search term) pairs for a given application, and human ratings for the relevance between (image, search term) pairs. Our approach achieves 0.96 AUC score for advertiser associated ground truth, outperforming the transformer+ResNet baseline and the fine-tuned CLIP model by 8% and 14%. For human labeled ground truth, our approach achieves 0.95 AUC score, outperforming the transformer+ResNet baseline and the fine-tuned CLIP model by 16% and 17%.

cs.CV

Corporate Bankruptcy Prediction with Domain-Adapted BERT

This study performs BERT-based analysis, which is a representative contextualized language model, on corporate disclosure data to predict impending bankruptcies. Prior literature on bankruptcy prediction mainly focuses on developing more sophisticated prediction methodologies with financial variables. However, in our study, we focus on improving the quality of input dataset. Specifically, we employ BERT model to perform sentiment analysis on MD&A disclosures. We show that BERT outperforms dictionary-based predictions and Word2Vec-based predictions in terms of adjusted R-square in logistic regression, k-nearest neighbor (kNN-5), and linear kernel support vector machine (SVM). Further, instead of pre-training the BERT model from scratch, we apply self-learning with confidence-based filtering to corporate disclosure data (10-K). We achieve the accuracy rate of 91.56% and demonstrate that the domain adaptation procedure brings a significant improvement in prediction accuracy.

cs.CL

Detecting Rumor Veracity with Only Textual Information by Double-Channel Structure

Kyle (1985) proposes two types of rumors: informed rumors which are based on some private information and uninformed rumors which are not based on any information (i.e. bluffing). Also, prior studies find that when people have credible source of information, they are likely to use a more confident textual tone in their spreading of rumors. Motivated by these theoretical findings, we propose a double-channel structure to determine the ex-ante veracity of rumors on social media. Our ultimate goal is to classify each rumor into true, false, or unverifiable category. We first assign each text into either certain (informed rumor) or uncertain (uninformed rumor) category. Then, we apply lie detection algorithm to informed rumors and thread-reply agreement detection algorithm to uninformed rumors. Using the dataset of SemEval 2019 Task 7, which requires ex-ante threefold classification (true, false, or unverifiable) of social media rumors, our model yields a macro-F1 score of 0.4027, outperforming all the baseline models and the second-place winner (Gorrell et al., 2019). Furthermore, we empirically validate that the double-channel structure outperforms single-channel structures which use either lie detection or agreement detection algorithm to all posts.

cs.CL

From Transcripts to Insights: Uncovering Corporate Risks Using Generative AI

We explore the value of generative AI tools, such as ChatGPT, in helping investors uncover dimensions of corporate risk. We develop and validate firm-level measures of risk exposure to political, climate, and AI-related risks. Using the GPT 3.5 model to generate risk summaries and assessments from the context provided by earnings call transcripts, we show that GPT-based measures possess significant information content and outperform the existing risk measures in predicting (abnormal) firm-level volatility and firms' choices such as investment and innovation. Importantly, information in risk assessments dominates that in risk summaries, establishing the value of general AI knowledge. We also find that generative AI is effective at detecting emerging risks, such as AI risk, which has soared in recent quarters. Our measures perform well both within and outside the GPT's training window and are priced in equity markets. Taken together, an AI-based approach to risk measurement provides useful insights to users of corporate disclosures at a low cost.

econ.GN

Bloated Disclosures: Can ChatGPT Help Investors Process Information?

Generative AI tools such as ChatGPT can fundamentally change the way investors process information. We probe the economic usefulness of these tools in summarizing complex corporate disclosures using the stock market as a laboratory. The unconstrained summaries are remarkably shorter compared to the originals, whereas their information content is amplified. When a document has a positive (negative) sentiment, its summary becomes more positive (negative). Importantly, the summaries are more effective at explaining stock market reactions to the disclosed information. Motivated by these findings, we propose a measure of information ``bloat." We show that bloated disclosure is associated with adverse capital market consequences, such as lower price efficiency and higher information asymmetry. Finally, we show that the model is effective at constructing targeted summaries that identify firms' (non-)financial performance. Collectively, our results indicate that generative AI adds considerable value for investors with information processing constraints.

econ.GN

Deep Drilling in the Time Domain with DECam: Survey Characterization

This paper presents a new optical imaging survey of four deep drilling fields (DDFs), two Galactic and two extragalactic, with the Dark Energy Camera (DECam) on the 4 meter Blanco telescope at the Cerro Tololo Inter-American Observatory (CTIO). During the first year of observations in 2021, $>$4000 images covering 21 square degrees (7 DECam pointings), with $\sim$40 epochs (nights) per field and 5 to 6 images per night per filter in $g$, $r$, $i$, and/or $z$, have become publicly available (the proprietary period for this program is waived). We describe the real-time difference-image pipeline and how alerts are distributed to brokers via the same distribution system as the Zwicky Transient Facility (ZTF). In this paper, we focus on the two extragalactic deep fields (COSMOS and ELAIS-S1), characterizing the detected sources and demonstrating that the survey design is effective for probing the discovery space of faint and fast variable and transient sources. We describe and make publicly available 4413 calibrated light curves based on difference-image detection photometry of transients and variables in the extragalactic fields. We also present preliminary scientific analysis regarding Solar System small bodies, stellar flares and variables, Galactic anomaly detection, fast-rising transients and variables, supernovae, and active galactic nuclei.

astro-ph.IM

The Dark Energy Survey Supernova Program results: Type Ia Supernova brightness correlates with host galaxy dust

Cosmological analyses with type Ia supernovae (SNe Ia) often assume a single empirical relation between color and luminosity ($\beta$) and do not account for varying host-galaxy dust properties. However, from studies of dust in large samples of galaxies, it is known that dust attenuation can vary significantly. Here we take advantage of state-of-the-art modeling of galaxy properties to characterize dust parameters (dust attenuation $A_V$, and a parameter describing the dust law slope $R_V$) for the Dark Energy Survey (DES) SN Ia host galaxies using the publicly available \texttt{BAGPIPES} code. Utilizing optical and infrared data of the hosts alone, we find three key aspects of host dust that impact SN Ia cosmology: 1) there exists a large range ($\sim1-6$) of host $R_V$ 2) high stellar mass hosts have $R_V$ on average $\sim0.7$ lower than that of low-mass hosts 3) there is a significant ($>3\sigma$) correlation between the Hubble diagram residuals of red SNe Ia that when corrected for reduces scatter by $\sim13\%$ and the significance of the ``mass step'' to $\sim1\sigma$. These represent independent confirmations of recent predictions based on dust that attempted to explain the puzzling ``mass step'' and intrinsic scatter ($\sigma_{\rm int}$) in SN Ia analyses. We also find that red-sequence galaxies have both lower and more peaked dust law slope distributions on average in comparison to non red-sequence galaxies. We find that the SN Ia $\beta$ and $\sigma_{\rm int}$ both differ by $>3\sigma$ when determined separately for red-sequence galaxy and all other galaxy hosts. The agreement between fitted host-$R_V$ and SN Ia $\beta$ \& $\sigma_{\rm int}$ suggests that host dust properties play a major role in SN Ia color-luminosity standardization and supports the claim that SN Ia intrinsic scatter is driven by $R_V$ variation.

astro-ph.CO

Real-time Cosmology with High Precision Spectroscopy and Astrometry

Breakthroughs in physics and astrophysics are often driven by technological advances, with the recent detection of gravitational waves being one such example. This white paper focuses upon how improved astrometric and spectroscopic measurements from a new generation of precise, accurate, and stable astronomical instrumentation can address two of the fundamental mysteries of our time -- dark energy and dark matter -- and probe the nature of spacetime. Instrumentation is now on the cusp of enabling new cosmological measurements based on redshifts (cosmic redshift drift) and extremely precise time-series measurements of accelerations, astrophysical source positions (astrometry), and angles (cosmic parallax). These allow tests of the fundamental framework of the universe (the Friedmann equations of general relativity and whether cosmic expansion is physically accelerating) and its contents (dark energy evolution and dark matter behavior), while also anchoring the cosmic distance scale ($H_0$).

astro-ph.CO

The HST See Change Program: I. Survey Design, Pipeline, and Supernova Discoveries

The See Change survey was designed to make $z>1$ cosmological measurements by efficiently discovering high-redshift Type Ia supernovae (SNe Ia) and improving cluster mass measurements through weak lensing. This survey observed twelve galaxy clusters with the Hubble Space Telescope spanning the redshift range $z=1.13$ to $1.75$, discovering 57 likely transients and 27 likely SNe Ia at $z\sim 0.8-2.3$. As in similar previous surveys (Dawson et al. 2009), this proved to be a highly efficient use of HST for SN observations; the See Change survey additionally tested the feasibility of maintaining, or further increasing, the efficiency at yet higher redshifts, where we have less detailed information on the expected cluster masses and star-formation rates. We find that the resulting number of SNe Ia per orbit is a factor of $\sim 8$ higher than for a field search, and 45% of our orbits contained an active SN Ia within 22 rest-frame days of peak, with one of the clusters by itself yielding 6 of the SNe Ia. We present the survey design, pipeline, and SN discoveries. Novel features include fully blinded SN searches, the first random forest candidate classifier for undersampled IR data (with a 50% detection threshold within 0.05 magnitudes of human searchers), real-time forward-modeling photometry of candidates, and semi-automated photometric classifications and follow-up forecasts. We also describe the spectroscopic follow-up, instrumental in measuring host-galaxy redshifts. The cosmology analysis of our sample will be presented in a companion paper.

astro-ph.CO

OzDES Reverberation Mapping Program: Lag recovery reliability for 6-year CIV analysis

We present the statistical methods that have been developed to analyse the OzDES reverberation mapping sample. To perform this statistical analysis we have created a suite of customisable simulations that mimic the characteristics of each source in the OzDES sample. These characteristics include: the variability in the photometric and spectroscopic lightcurves, the measurement uncertainties, and the observational cadence. By simulating the sources in the OzDES sample that contain the CIV emission line, we developed a set of criteria that rank the reliability of a recovered time lag depending on the agreement between different recovery methods, the magnitude of the uncertainties, and the rate at which false positives were found in the simulations. These criteria were applied to simulated light curves and these results used to estimate the quality of the resulting Radius-Luminosity relation.We grade the results using three quality levels (gold, silver and bronze). The input slope of the R-L relation was recovered within $1\sigma$ for each of the three quality samples, with the gold standard having the lowest dispersion with a recovered a R-L relation slope of $0.454\pm 0.016$ with an input slope of 0.47. Future work will apply these methods to the entire OzDES sample of 771 AGN.

astro-ph.GA

Inflation and Dark Energy from spectroscopy at $z > 2$

The expansion of the Universe is understood to have accelerated during two epochs: in its very first moments during a period of Inflation and much more recently, at $z < 1$, when Dark Energy is hypothesized to drive cosmic acceleration. The undiscovered mechanisms behind these two epochs represent some of the most important open problems in fundamental physics. The large cosmological volume at $2 < z < 5$, together with the ability to efficiently target high-$z$ galaxies with known techniques, enables large gains in the study of Inflation and Dark Energy. A future spectroscopic survey can test the Gaussianity of the initial conditions up to a factor of ~50 better than our current bounds, crossing the crucial theoretical threshold of $\sigma(f_{NL}^{\rm local})$ of order unity that separates single field and multi-field models. Simultaneously, it can measure the fraction of Dark Energy at the percent level up to $z = 5$, thus serving as an unprecedented test of the standard model and opening up a tremendous discovery space.

astro-ph.CO

Direct Acceleration: Cosmic and Exoplanet Synergies

Direct measurement of acceleration is a key scientific goal for both cosmology and exoplanets. For cosmology, the concept of redshift drift (more than 60 years old by the 2020s) could directly establish the Friedmann-Lema{\^\i}tre-Robertson-Walker model. It would increase the dark energy figure of merit by a factor of 3 beyond Stage 4 experiments, in combination with cosmic microwave background measurements. For exoplanets, the same technology required provides unprecedented radial velocity accuracy, enabling detection of Earth mass planets in the habitable zone. Other science cases include mapping the Milky Way gravitational potential and testing its dark matter distribution.

astro-ph.IM

Gravitational wave cosmology and astrophysics with large spectroscopic galaxy surveys

During the next decade, gravitational waves will be observed from hundreds of binary inspiral events. When the redshifts of the host galaxies are known, these events can be used as `standard sirens', sensitive to the expansion rate of the Universe. Measurements of the Hubble constant $H_0$ from standard sirens can be done independently of other cosmological probes, and events occurring at $z<0.1$ will allow us to infer $H_0$ independently of cosmological models. The next generation of spectroscopic galaxy surveys will play a crucial role in reducing systematic uncertainties in $H_0$ from standard sirens, particularly for the numerous `dark sirens' which do not have an electromagnetic counterpart. In combination with large spectroscopic data sets, standard sirens with an EM counterpart are expected to constrain $H_0$ to $\sim 1-2\%$ precision within the next decade. This is competitive with the best estimates of $H_0$ obtained to date and will help illuminate the current tension between existing measurements. Information on the galaxies that host the gravitational wave events will also shed light on the origin and evolution of compact object binaries.

astro-ph.CO

The Next Generation of Cosmological Measurements with Type Ia Supernovae

While Type Ia Supernovae (SNe Ia) are one of the most mature cosmological probes, the next era promises to be extremely exciting in the number of different ways SNe Ia are used to measure various cosmological parameters. Here we review the experiments in the 2020s that will yield orders of magnitudes more SNe Ia, and the new understandings and capabilities to constrain systematic uncertainties at a level to match these statistics. We then discuss five different cosmological probes with SNe Ia: the conventional Hubble diagram for measuring dark energy properties, the distance ladder for measuring the Hubble constant, peculiar velocities and weak lensing for measuring sigma8 and strong-lens measurements of H0 and other cosmological parameters. For each of these probes, we discuss the experiments that will provide the best measurements and also the SN Ia-related systematics that affect each one.

astro-ph.CO

Science-Driven Optimization of the LSST Observing Strategy

The Large Synoptic Survey Telescope is designed to provide an unprecedented optical imaging dataset that will support investigations of our Solar System, Galaxy and Universe, across half the sky and over ten years of repeated observation. However, exactly how the LSST observations will be taken (the observing strategy or "cadence") is not yet finalized. In this dynamically-evolving community white paper, we explore how the detailed performance of the anticipated science investigations is expected to depend on small changes to the LSST observing strategy. Using realistic simulations of the LSST schedule and observation properties, we design and compute diagnostic metrics and Figures of Merit that provide quantitative evaluations of different observing strategies, analyzing their impact on a wide range of proposed science projects. This is work in progress: we are using this white paper to communicate to each other the relative merits of the observing strategy choices that could be made, in an effort to maximize the scientific value of the survey. The investigation of some science cases leads to suggestions for new strategies that could be simulated and potentially adopted. Notably, we find motivation for exploring departures from a spatially uniform annual tiling of the sky: focusing instead on different parts of the survey area in different years in a "rolling cadence" is likely to have significant benefits for a number of time domain and moving object astronomy projects. The communal assembly of a suite of quantified and homogeneously coded metrics is the vital first step towards an automated, systematic, science-based assessment of any given cadence simulation, that will enable the scheduling of the LSST to be as well-informed as possible.

astro-ph.IM