The cancer_data from kevinhu

cancer_data's People

Contributors

Stargazers

Watchers

cancer_data's Issues

Create documentation site

tcga_normalized_gene_expression fails to download due to md5sum mismatch

Hi, thanks for putting this repo together, it looks very handy.

On cancer_data version 0.1.0, I tried to download the tcga_normalized_gene_expression dataset via

cancer_data.download("tcga_normalized_gene_expression"),

but this failed with the message:

243iB [00:00, 58.9kiB/s]
EB++AdjustPANCAN_IlluminaHiSeq_RNASeqV2.geneExp.xena.gz does not match provided md5sum. Attempting second download.
Downloading https://pancanatlas.xenahubs.net/download/EB++AdjustPANCAN_IlluminaHiSeq_RNASeqV2.geneExp.xena.gz
243iB [00:00, 36.1kiB/s]
Second download of EB++AdjustPANCAN_IlluminaHiSeq_RNASeqV2.geneExp.xena.gz failed. Recommend manual inspection.

Yet when I manually inspect the md5sum of the .gz, everything looks ok:

import hashlib

import cancer_data

schema_md5 = cancer_data.schema().loc['tcga_normalized_gene_expression']['downloaded_md5']

fname = "/Users/pat/Downloads/EB++AdjustPANCAN_IlluminaHiSeq_RNASeqV2.geneExp.xena.gz"

with open(fname, "rb") as f:
    data = f.read()
    observed_md5 = hashlib.md5(data).hexdigest()

assert schema_md5 == observed_md5  # "5fbfb5a4854a2cfc8a95c3ada5379fd4"

Am I doing something silly? Thanks in advance.

Update DepMap copy number and Avana data

https://forum.depmap.org/t/important-update-issues-with-depmap-20q4-data/344

DepMap Public 22Q4

There are many changes in the recent DepMap release.

Add flake8+black pre-commit hooks

Collisions in downloaded_name break caching

Hi, it looks like in cases where two schema entries share the same downloaded_name, any operation that touches both will show md5 mismatches and rerun the download step.

You could put a download_as field in the schema, or form a different filename out of a combination of fields guaranteed to be unique. Then rename the file after download.

Recommend Projects