Skip to content

Datasets

tausurv.datasets is a registry of survival cohorts that download on first use, verify against a pinned SHA256, and cache content-addressed.

from tausurv.datasets import load_dataset, list_datasets, list_variants
list_datasets() # every loadable table
list_datasets(base_only=True) # one name per study
list_datasets(tag="competing-risks")
X, time, event = load_dataset("pbc")

A name is base or base:variant. The base name resolves to the reading a survival textbook would call default; a variant names another published processing of the same rows. This matters because the literature does not agree on a single canonical table for most cohorts, and a score is only interpretable against the table it was computed on.

list_variants("pbc")
# ['pbc', 'pbc:randomised', 'pbc:transplant']

Names that refer to different tables in different sources:

you may meanregistry namewhat it is
GBSG / GBSG2gbsgthe 686-patient German trial
GBSG (DeepSurv)gbsg_rotterdam2232 rows, Rotterdam + German trial combined
PBCpbc / pbc:randomisedall 418 patients / the 312 randomised ones
SUPPORTsupport / support:nonleakyraw 47 columns / baseline covariates only

Raw SUPPORT ships the SUPPORT prognostic model’s own survival estimates as covariates: surv6m alone scores c-index 0.72 against the endpoint, above published models fitted on real covariates. support:nonleaky removes those columns. The raw entry stays, so the leak stays inspectable.

Aliases (gbsg2, actg320, diabetic, …) resolve but never appear in list_datasets(), so each table has exactly one canonical name.

Most datasets are OPEN and need no setup. SEER, UNOS, MIMIC, full METABRIC and Framingham cannot be redistributed; their specs and parsers ship anyway, and loading one raises with the steps to obtain it:

load_dataset("seer", path="/path/to/my/seer/export")

Four benchmark tables are distributed as HDF5 and need pip install 'tausurv[deepsurv]': metabric, gbsg_rotterdam, support:deepsurv, whas_deepsurv. Those files carry no column names, so their covariates are exposed positionally as x0, x1, … rather than under names inferred from a paper and impossible to verify against the data.

Scatter plot of the 64 open studies: number of subjects on a log axis from 23 to 17549, event rate from 2.1% to 100%, coloured by single risk, two causes or three causes.

Each point is one open study in its base reading; variants and gated datasets are omitted. The event rate is the fraction of subjects with an observed event of any cause. Sizes range from 23 subjects (aml) to 17549 (nafld), event rates from 2.1% (pneumon) to 100% (hoel, ifluid).

datasetndeventsoutcometags
aids1151118.3%singleclinical,trial,benchmark,rare-events
aids:death1151112.3%singleclinical,trial,rare-events
alloauto101149.5%singleclinical,transplant,non-proportional
allograft34185.3%singleclinical,transplant,clustered
aml23178.3%singleclinical,trial
ashkenazi3920112.1%singleclinical,genetics,clustered
baboon152038.2%singleecology,left-truncated
bfeed927896.2%singlebehavioural,survey
bladder85355.3%singleclinical,trial,first-event
bmt1371160.6%singleclinical,transplant
bmt:competing1371160.6%2 causesclinical,transplant,competing-risks
bnct30190.0%singlepreclinical,trial
breast_cancer_gse73901988025.8%singleclinical,genomics,high-dimensional
btrial45153.3%singleclinical
burn1541131.2%singleclinical,trial
capacitor64250.0%singlereliability
cgd1281034.4%singleclinical,trial,first-event
channing462238.1%singleclinical,left-truncated
colon9291254.5%2 causesclinical,competing-risks
colon:cause19291250.4%singleclinical
colon:cause2929124.1%singleclinical
colon:death9291248.7%singleclinical,trial
colon:recurrence9291250.4%singleclinical,trial
drughiv34179.4%singleclinical
flchain7874827.5%singleclinical
flchain:complete6524830.1%singleclinical
flchain:positive7871827.5%singleclinical
framingham---credentialedclinical,epidemiology,cardiology,longitudinal
gastric_xelox48066.7%singleclinical,single-arm
gbsg686843.6%singleclinical
gbsg_rotterdam2232856.8%singleclinical,benchmark,breast-cancer
genfan70017.1%singlereliability
hepatocellular2274342.7%singleclinical,biomarkers
hepatocellular:rfs2274363.0%singleclinical,biomarkers
hodgkins43460.5%singleclinical,transplant
hoel1811100.0%3 causescompeting-risks,preclinical
hoel:cause1181128.2%singlepreclinical
hoel:cause2181129.3%singlepreclinical
hoel:cause3181142.5%singlepreclinical
ifluid411100.0%singlereliability
imotor40142.5%singlereliability
kidney_catheter76376.3%singleclinical,frailty,clustered
kidney_infection119121.8%singleclinical
kidney_transplant863416.2%singleclinical
larynx90355.6%singleclinical
leukemia42271.4%singleclinical,trial,clustered
lung228872.4%singleclinical
lung:complete168772.0%singleclinical
melanoma205534.6%2 causesclinical,competing-risks
melanoma:cause1205527.8%singleclinical
melanoma:cause220556.8%singleclinical
metabric19041057.9%singleclinical,benchmark,breast-cancer
metabric:full---credentialedclinical,genomics,breast-cancer,high-dimensional
mgus241794.2%2 causesclinical,competing-risks
mgus21384670.4%2 causesclinical,competing-risks
mgus2:cause1138468.3%singleclinical
mgus2:cause21384662.1%singleclinical
mgus:cause1241726.6%singleclinical
mgus:cause2241767.6%singleclinical
mgus:death241793.4%singleclinical
mimic---credentialedclinical,critical-care,ehr,large
myeloid646349.5%singleclinical,trial
myeloma3882271.3%singleclinical,left-truncated
nafld1754957.8%singleclinical,epidemiology
nwtco4028614.2%singleclinical
ovarian26446.2%singleclinical
pbc4181738.5%singleclinical
pbc:randomised3121740.1%singleclinical,trial
pbc:transplant4181744.5%2 causesclinical,competing-risks
pharmaco_smoking1251171.2%singleclinical,trial,behavioural
pneumon3470132.1%singleclinical,epidemiology,rare-events
prostate14294328.3%2 causesclinical,competing-risks,registry
prostate:cause11429435.6%singleclinical,registry
prostate:cause214294322.7%singleclinical,registry
psych26253.8%singleclinical,left-truncated
retinopathy394639.3%singleclinical,clustered
rossi432726.4%singlerecidivism
rotterdam29821042.7%singleclinical,breast-cancer
rotterdam:recurrence29821050.9%singleclinical,breast-cancer
rotterdam:rfs29821057.4%singleclinical,breast-cancer,benchmark
seer---user_providedclinical,competing-risks,registry,large
stanford2184261.4%singleclinical
std8772139.6%singleclinical,epidemiology
support91054568.1%singleclinical
support:deepsurv88731568.0%singleclinical,benchmark,critical-care
support:nonleaky91053168.1%singleclinical,benchmark
telco_churn70431826.5%singlechurn
tongue80166.2%singleclinical
transplant815490.7%3 causesclinical,competing-risks
transplant:cause1815478.0%singleclinical
transplant:cause281544.5%singleclinical
transplant:cause381548.1%singleclinical
twins24133.3%singleepidemiology,clustered
udca170442.4%singleclinical,trial
unos---user_providedclinical,transplant,registry,large
valve_seat41058.5%singlereliability,first-event
veteran137693.4%singleclinical
waltons163195.7%singleclinical
whas5005001443.0%singleclinical,benchmark,cardiology
whas_deepsurv1638742.1%singleclinical,benchmark,cardiology