科研速览 · Science Skim继续刷下去 · Keep skimming →
◇ bioRxiv2026-08-11· genomics

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models

A. Larey, E. Dahan, A. B. Amit Bleiweiss, R. Kellerman, G. Leib, O. Nayshool, D. Ofer, T. Zinger, D. Dominissini, G. Rechavi, N. Bussola, S. Lee, S. O'Connell, D. Hoang, M. Wirth, A. W. Charney, Y. Shavit, N. Daniel

原始摘要(英文原文)· Original abstract
The rapid scaling of Genomic Foundation Models (GFMs) has created a critical need for standardized evaluation frameworks. Current benchmarking practices are often fragmented, relying on model-specific preprocessing and inconsistent metric implementations that hinder reproducible comparisons. We present GFMBench-API, a high-level Python interface designed to unify the evaluation lifecycle of GFMs. GFMBench-API provides a modular "middleware" architecture that decouples model-specific tokenization and embedding logic from task-specific data streams and performance metrics. By standardizing the input/output schemas for common genomic tasks, such as regulatory element prediction, variant effect scoring, and long-range interaction mapping, GFMBench-API enables researchers to integrate new models or tasks with minimal "glue code." Our interface ensures mathematical consistency across evaluations, providing a robust foundation for the transparent and systematic benchmarking of GFMs.
读原文 · Read the paper ↗

AI 追问PRO

登录后使用 AI 追问

讨论区

登录后参与讨论

相关论文 · Related

GFMBench-API: A Standardized Interface for Benchmarking Genomic Foundation Models — 科研速览 Science Skim