So many Error messages: please help,about eudoraleer/scasa

Comments (13)

nghiavtr commented on September 26, 2024

Thank you for using Scasa in your research.

The error is at the mapping step of alevin, likely it can not find out the input fastq files. Please check if the file names if they are in the right format. It is noted that the names of fastq files should contain "R1" and "R2", please see the details here: https://github.com/eudoraleer/scasa/wiki#6-input-fastq-files

Best,
Nghia

from scasa.

RenaeAtkinson commented on September 26, 2024

Hi Nghia, This is my code: scasa –project HNVC02 \ --mapper salmon_alevin \ --align YES \ --quant YES \ --in /network/rit/lab/conklinlab/Renae/HNVC/HNVC02/SRR10340946/ \ --fastq SRR10340946_R1.fastq,SRR10340946_R2.fastq\ --out /network/rit/lab/conklinlab/Renae/SCASA/HNVC02/ \ --ref /network/rit/lab/conklinlab/Renae/SCASA/refMrna.fa \ --whitelist /network/rit/lab/conklinlab/Renae/HNVC/V2/737K-august-2016.txt \ --tech 10xv2 \ --nthreads 32 \ --index YES \ --xmatrix alevin Renae Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows From: Trung Nghia ***@***.***> Sent: Friday, April 14, 2023 6:43 AM To: ***@***.***> Cc: ***@***.***>; ***@***.***> Subject: Re: [eudoraleer/scasa] So many Error messages: please help (Issue #8) Hi @RenaeAtkinson<https://github.com/RenaeAtkinson>, Thank you for using Scasa in your research. The error is at the mapping step of alevin, likely it can not find out the input fastq files. Please check if the file names if they are in the right format. It is noted that the names of fastq files should contain "R1" and "R2", please see the details here: https://github.com/eudoraleer/scasa/wiki#6-input-fastq-files Best, Nghia — Reply to this email directly, view it on GitHub<#8 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AT4ASO2U2E74X6ZZZTJQ6XTXBES6RANCNFSM6AAAAAAW55ORHY>. You are receiving this because you were mentioned.Message ID: ***@***.***>

from scasa.

nghiavtr commented on September 26, 2024

hi @RenaeAtkinson,

I don't see a clear issue in your command except "--project" instead of "–project". Most default values parameters are used in your command, so can you try again with the shorter version below:

scasa --in /network/rit/lab/conklinlab/Renae/HNVC/HNVC02/SRR10340946/
--fastq SRR10340946_R1.fastq,SRR10340946_R2.fastq
--out /network/rit/lab/conklinlab/Renae/SCASA/HNVC02/
--ref /network/rit/lab/conklinlab/Renae/SCASA/refMrna.fa
--whitelist /network/rit/lab/conklinlab/Renae/HNVC/V2/737K-august-2016.txt
--tech 10xv2
--nthreads 32

Best,
Nghia

from scasa.

RenaeAtkinson commented on September 26, 2024

Hi Nghia, Any idea how I can fix these errors I am getting? Error in file(con, "r") : cannot open the connection Calls: readLines -> file In addition: Warning message: In file(con, "r") : cannot open file '/network/rit/lab/conklinlab/Renae/SCASA/HNVC02//SCASA_My_Project_20230418104957/1ALIGN//SRR10340946_alignout/alevin/bfh.txt': No such file or directory Execution halted Loading required package: iterators Loading required package: parallel Error in readChar(con, 5L, useBytes = TRUE) : cannot open the connection Calls: load -> readChar In addition: Warning message: In readChar(con, 5L, useBytes = TRUE) : cannot open compressed file '/network/rit/lab/conklinlab/Renae/SCASA/HNVC02/SCASA_My_Project_20230418104957/2QUANT/SRR10340946_quant/Sample_eqClass.RData', probable reason 'No such file or directory' Execution halted Error in readChar(con, 5L, useBytes = TRUE) : cannot open the connection Calls: load -> readChar In addition: Warning message: In readChar(con, 5L, useBytes = TRUE) : cannot open compressed file '/network/rit/lab/conklinlab/Renae/SCASA/HNVC02//SCASA_My_Project_20230418104957/2QUANT//SRR10340946_quant//scasa_isoform_expression.RData', probable reason 'No such file or directory' Execution halted Best, Renae Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows From: Trung Nghia ***@***.***> Sent: Friday, April 14, 2023 12:59 PM To: ***@***.***> Cc: ***@***.***>; ***@***.***> Subject: Re: [eudoraleer/scasa] So many Error messages: please help (Issue #8) hi @RenaeAtkinson<https://github.com/RenaeAtkinson>, I don't see a clear issue in your command except "--project" instead of "–project". Most default values parameters are used in your command, so can you try again with the shorter version below: scasa --in /network/rit/lab/conklinlab/Renae/HNVC/HNVC02/SRR10340946/ --fastq SRR10340946_R1.fastq,SRR10340946_R2.fastq --out /network/rit/lab/conklinlab/Renae/SCASA/HNVC02/ --ref /network/rit/lab/conklinlab/Renae/SCASA/refMrna.fa --whitelist /network/rit/lab/conklinlab/Renae/HNVC/V2/737K-august-2016.txt --tech 10xv2 --nthreads 32 Best, Nghia — Reply to this email directly, view it on GitHub<#8 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AT4ASOYKNZYBAYATRG7LL6LXBF7ADANCNFSM6AAAAAAW55ORHY>. You are receiving this because you were mentioned.Message ID: ***@***.***>

from scasa.

nghiavtr commented on September 26, 2024

Hi,
The error indicates that the alignment by Alevin has not been performed.
I am thinking of the reason that the input filename is not correct, but it is so weird because likely it is not.

Can you try to test the issue by renaming SRR10340946_R1.fastq by Sample_01_S1_L001_R1_001.fastq and SRR10340946_R2.fastq by Sample_01_S1_L001_R2_001.fastq as in the sample files of Scasa

Another possibility is that R1 and R2 files do not contain the correct information (one for sequence content and another for barcode+UMI), in that case we just switch the file name.

Let try and please let me know if any of these ways work, thanks!

Nghia

from scasa.

RenaeAtkinson commented on September 26, 2024

I had tried that naming convention before and that did not work. The names are according to the split files downloaded from SRA Renae Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows From: Trung Nghia ***@***.***> Sent: Tuesday, April 18, 2023 11:14 AM To: ***@***.***> Cc: ***@***.***>; ***@***.***> Subject: Re: [eudoraleer/scasa] So many Error messages: please help (Issue #8) Hi, The error indicates that the alignment by Alevin has not been performed. I am thinking of the reason that the input filename is not correct, but it is so weird because likely it is not. Can you try to test the issue by renaming SRR10340946_R1.fastq by Sample_01_S1_L001_R1_001.fastq and SRR10340946_R2.fastq by Sample_01_S1_L001_R2_001.fastq as in the sample files of Scasa Another possibility is that R1 and R2 files do not contain the correct information (one for sequence content and another for barcode+UMI), in that case we just switch the file name. Let try and please let me know if any of these ways work, thanks! Nghia — Reply to this email directly, view it on GitHub<#8 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AT4ASOZAX7N5CZVUTL6DJ2TXB2VVBANCNFSM6AAAAAAW55ORHY>. You are receiving this because you were mentioned.Message ID: ***@***.***>

from scasa.

nghiavtr commented on September 26, 2024

Hi,

It is really strange. Can you put the few first lines of R1 and R2 here?
And if possible, can you send me the files or a subset of reads from the files, I will try to reproduce the error by running Scasa on the files.

Nghia

from scasa.

RenaeAtkinson commented on September 26, 2024

Sure thing, It’s from a publicly available dataset and the sample I am working on is this SRA fastq file: https://www.ncbi.nlm.nih.gov/sra/?term=SRR10340946 Renae Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows From: Trung Nghia ***@***.***> Sent: Wednesday, April 19, 2023 6:18 AM To: ***@***.***> Cc: ***@***.***>; ***@***.***> Subject: Re: [eudoraleer/scasa] So many Error messages: please help (Issue #8) Hi, It is really strange. Can you put the few first lines of R1 and R2 here? And if possible, can you send me the files or a subset of reads from the files, I will try to reproduce the error by running Scasa on the files. Nghia — Reply to this email directly, view it on GitHub<#8 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AT4ASO32J5KROSJK2WWMSJ3XB63XDANCNFSM6AAAAAAW55ORHY>. You are receiving this because you were mentioned.Message ID: ***@***.***>

from scasa.

nghiavtr commented on September 26, 2024

hi @RenaeAtkinson ,

Well, I can not reproduce your error, please see the codes I tried below. So it is sure that the issue is not at the input data format.

I guess you might have missed some steps, for example forgetting to add the paths of scasa or salmon alevin( export PATH and export LD_LIBRARY_PATH)

Nghia


##################################################################
# 1. Download scasa:
##################################################################
wget https://github.com/eudoraleer/scasa/releases/download/scasa.v1.0.0/scasa_v1.0.0.tar.gz
tar -xzvf scasa_v1.0.0.tar.gz
export PATH=$PWD/scasa:$PATH

##################################################################
# 2. Download salmon alevin:
##################################################################
wget https://github.com/COMBINE-lab/salmon/releases/download/v1.4.0/salmon-1.4.0_linux_x86_64.tar.gz
tar -xzvf salmon-1.4.0_linux_x86_64.tar.gz
export PATH=$PWD/salmon-latest_linux_x86_64/bin:$PATH
export LD_LIBRARY_PATH=$PWD/salmon-latest_linux_x86_64/lib:$LD_LIBRARY_PATH

##################################################################
# 3. Download UCSC hg38 cDNA fasta reference:
##################################################################
mkdir Annotation
cd Annotation
wget https://www.dropbox.com/s/xoa6yl562a5lv35/refMrna.fa.gz
refPath=$PWD/refMrna.fa.gz

wget https://github.com/10XGenomics/cellranger/blob/master/lib/python/cellranger/barcodes/737K-august-2016.txt
whitelistFile=$PWD/737K-august-2016.txt

cd ..

##################################################################
# 4. Download the CITE-seq RNA samples:
##################################################################

mkdir CiteSeqData
cd CiteSeqData

### use sratools to download the sample
# module load sratools/3.0.0
prefetch SRR10340946
cd SRR10340946
fastq-dump --gzip --split-3 SRR10340946.sra

#change the name
mv SRR10340946_1.fastq.gz SRR10340946_L001_R1_001.fastq.gz
mv SRR10340946_2.fastq.gz SRR10340946_L001_R2_001.fastq.gz

InputDir=$PWD
cd ..

#number of threads
threadNum=$(nproc)

#run scasa
scasa --in $InputDir --fastq SRR10340946_L001_R1_001.fastq.gz,SRR10340946_L001_R2_001.fastq.gz --ref $refPath  --tech 10xv2 --nthreads $threadNum --whitelist $whitelistFile --out ScasaOut_SRR10340946

from scasa.

RenaeAtkinson commented on September 26, 2024

Hi Nghia, I was trying to read in a particular file format but the format of the file did not match the format requested in the R function (of a different package). I will have to process the file in R to get it into the format required by the R function for it to be accepted. I got the same error in R that I saw in the command line when running SCASA! Error in file(con, "r") : cannot open the connection In addition: Warning message: In file(con, "r") : cannot open file 'C:\Users\renae\Desktop\Rprojects\SingleCellar-Learn\Human_genesets\Human_genesets\human.signature.genes.v2.gmt': No such file or directory I am excited because now I know what the error with scasa meant. It meant that the R function was not able to process the file provided into the format that scasa requires and so produced the error. The error occurs at “Begin scasa quantification for sample SRR..”. Does that shed any light on what could be going on and how you could help me? I would really love it this could work. What you produced in your paper is exactly what I want. Renae Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows From: Trung Nghia ***@***.***> Sent: Friday, April 21, 2023 2:22 AM To: ***@***.***> Cc: ***@***.***>; ***@***.***> Subject: Re: [eudoraleer/scasa] So many Error messages: please help (Issue #8) hi @RenaeAtkinson<https://github.com/RenaeAtkinson> , Well, I can not reproduce your error, please see the codes I tried below. So it is sure that the issue is not at the input data format. I guess you might have missed some steps, for example forgetting to add the paths of scasa or salmon alevin( export PATH and export LD_LIBRARY_PATH) Nghia ################################################################## 1. Download scasa: ################################################################## wget https://github.com/eudoraleer/scasa/releases/download/scasa.v1.0.0/scasa_v1.0.0.tar.gz tar -xzvf scasa_v1.0.0.tar.gz export PATH=$PWD/scasa:$PATH ################################################################## 2. Download salmon alevin: ################################################################## wget https://github.com/COMBINE-lab/salmon/releases/download/v1.4.0/salmon-1.4.0_linux_x86_64.tar.gz tar -xzvf salmon-1.4.0_linux_x86_64.tar.gz export PATH=$PWD/salmon-latest_linux_x86_64/bin:$PATH export LD_LIBRARY_PATH=$PWD/salmon-latest_linux_x86_64/lib:$LD_LIBRARY_PATH ################################################################## 3. Download UCSC hg38 cDNA fasta reference: ################################################################## mkdir Annotation cd Annotation wget https://www.dropbox.com/s/xoa6yl562a5lv35/refMrna.fa.gz refPath=$PWD/refMrna.fa.gz wget https://github.com/10XGenomics/cellranger/blob/master/lib/python/cellranger/barcodes/737K-august-2016.txt whitelistFile=$PWD/737K-august-2016.txt cd .. ################################################################## 4. Download the CITE-seq RNA samples: ################################################################## mkdir CiteSeqData cd CiteSeqData use sratools to download the sample module load sratools/3.0.0 prefetch SRR10340946 cd SRR10340946 fastq-dump --gzip --split-3 SRR10340946.sra #change the name mv SRR10340946_1.fastq.gz SRR10340946_L001_R1_001.fastq.gz mv SRR10340946_2.fastq.gz SRR10340946_L001_R2_001.fastq.gz InputDir=$PWD cd .. #number of threads threadNum=$(nproc) #run scasa scasa --in $InputDir --fastq SRR10340946_L001_R1_001.fastq.gz,SRR10340946_L001_R2_001.fastq.gz --ref $refPath --tech 10xv2 --nthreads $threadNum --whitelist $whitelistFile --out ScasaOut_SRR10340946 — Reply to this email directly, view it on GitHub<#8 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AT4ASO657ECPU4VXW76FRX3XCIRR3ANCNFSM6AAAAAAW55ORHY>. You are receiving this because you were mentioned.Message ID: ***@***.***>

from scasa.

nghiavtr commented on September 26, 2024

Hi @RenaeAtkinson,

If you see the message: 'Error in file(con, "r") : cannot open the connection', it is definitely that the program can not find out the file and so it is not the issue of Scasa.

I have tried to run Scasa with your working sample SRR10340946 on my linux computer, it worked well without error. I have provided you the codes previously (but I forgot to put them in the code format, very sorry). So I put the codes again below. I use the sratools to download SRR10340946 data. You just need to copy-and-paste the command lines and it should work.

Nghia

##################################################################
# 1. Download scasa:
##################################################################
wget https://github.com/eudoraleer/scasa/releases/download/scasa.v1.0.0/scasa_v1.0.0.tar.gz
tar -xzvf scasa_v1.0.0.tar.gz
export PATH=$PWD/scasa:$PATH

##################################################################
# 2. Download salmon alevin:
##################################################################
wget https://github.com/COMBINE-lab/salmon/releases/download/v1.4.0/salmon-1.4.0_linux_x86_64.tar.gz
tar -xzvf salmon-1.4.0_linux_x86_64.tar.gz
export PATH=$PWD/salmon-latest_linux_x86_64/bin:$PATH
export LD_LIBRARY_PATH=$PWD/salmon-latest_linux_x86_64/lib:$LD_LIBRARY_PATH

##################################################################
# 3. Download UCSC hg38 cDNA fasta reference:
##################################################################
mkdir Annotation
cd Annotation
wget https://www.dropbox.com/s/xoa6yl562a5lv35/refMrna.fa.gz
refPath=$PWD/refMrna.fa.gz

wget https://github.com/10XGenomics/cellranger/blob/master/lib/python/cellranger/barcodes/737K-august-2016.txt
whitelistFile=$PWD/737K-august-2016.txt

cd ..

##################################################################
# 4. Download the CITE-seq RNA samples:
##################################################################

mkdir CiteSeqData
cd CiteSeqData

### use sratools to download the sample
# module load sratools/3.0.0
prefetch SRR10340946
cd SRR10340946
fastq-dump --gzip --split-3 SRR10340946.sra

#change the name
mv SRR10340946_1.fastq.gz SRR10340946_L001_R1_001.fastq.gz
mv SRR10340946_2.fastq.gz SRR10340946_L001_R2_001.fastq.gz

InputDir=$PWD
cd ..

#number of threads
threadNum=$(nproc)

#run scasa
scasa --in $InputDir --fastq SRR10340946_L001_R1_001.fastq.gz,SRR10340946_L001_R2_001.fastq.gz --ref $refPath  --tech 10xv2 --nthreads $threadNum --whitelist $whitelistFile --out ScasaOut_SRR10340946

from scasa.

RenaeAtkinson commented on September 26, 2024

Hi Nghia, So I use salmon in a conda environment on my Linux server. I just updated it to through conda. I have version 1.10.1. I did everything including redownloading the sra file. The first error I get is this: mkdir: cannot create directory ‘ScasaOut_SRR10340946/SCASA_My_Project_20230518140856/’: File exists Is this a problem with scasa? The second error I get is Error in file(con, "r") : cannot open the connection Calls: readLines -> file In addition: Warning message: In file(con, "r") : cannot open file 'ScasaOut_SRR10340946/SCASA_My_Project_20230518140856/1ALIGN//SRR10340946_L001_alignout/alevin/bfh.txt': No such file or directory Execution halted This suggests to me that the program is having a problem making the directory/file bfh.txt. A similar error emerged later In readChar(con, 5L, useBytes = TRUE) : cannot open compressed file 'ScasaOut_SRR10340946/SCASA_My_Project_20230518140856/2QUANT//SRR10340946_L001_quant//scasa_isoform_expression.RData', probable reason 'No such file or directory' Execution halted Any ideas what could be the issue? Am I the only person having this problem? Renae Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows From: Trung Nghia ***@***.***> Sent: Thursday, May 18, 2023 1:32 AM To: ***@***.***> Cc: ***@***.***>; ***@***.***> Subject: Re: [eudoraleer/scasa] So many Error messages: please help (Issue #8) Hi @RenaeAtkinson<https://github.com/RenaeAtkinson>, If you see the message: 'Error in file(con, "r") : cannot open the connection', it is definitely that the program can not find out the file and so it is not the issue of Scasa. I have tried to run Scasa with your working sample SRR10340946 on my linux computer, it worked well without error. I have provided you the codes previously (but I forgot to put them in the code format, very sorry). So I put the codes again below. I use the sratools to download SRR10340946 data. You just need to copy-and-paste the command lines and it should work. Nghia ################################################################## # 1. Download scasa: ################################################################## wget https://github.com/eudoraleer/scasa/releases/download/scasa.v1.0.0/scasa_v1.0.0.tar.gz tar -xzvf scasa_v1.0.0.tar.gz export PATH=$PWD/scasa:$PATH ################################################################## # 2. Download salmon alevin: ################################################################## wget https://github.com/COMBINE-lab/salmon/releases/download/v1.4.0/salmon-1.4.0_linux_x86_64.tar.gz tar -xzvf salmon-1.4.0_linux_x86_64.tar.gz export PATH=$PWD/salmon-latest_linux_x86_64/bin:$PATH export LD_LIBRARY_PATH=$PWD/salmon-latest_linux_x86_64/lib:$LD_LIBRARY_PATH ################################################################## # 3. Download UCSC hg38 cDNA fasta reference: ################################################################## mkdir Annotation cd Annotation wget https://www.dropbox.com/s/xoa6yl562a5lv35/refMrna.fa.gz refPath=$PWD/refMrna.fa.gz wget https://github.com/10XGenomics/cellranger/blob/master/lib/python/cellranger/barcodes/737K-august-2016.txt whitelistFile=$PWD/737K-august-2016.txt cd .. ################################################################## # 4. Download the CITE-seq RNA samples: ################################################################## mkdir CiteSeqData cd CiteSeqData ### use sratools to download the sample # module load sratools/3.0.0 prefetch SRR10340946 cd SRR10340946 fastq-dump --gzip --split-3 SRR10340946.sra #change the name mv SRR10340946_1.fastq.gz SRR10340946_L001_R1_001.fastq.gz mv SRR10340946_2.fastq.gz SRR10340946_L001_R2_001.fastq.gz InputDir=$PWD cd .. #number of threads threadNum=$(nproc) #run scasa scasa --in $InputDir --fastq SRR10340946_L001_R1_001.fastq.gz,SRR10340946_L001_R2_001.fastq.gz --ref $refPath --tech 10xv2 --nthreads $threadNum --whitelist $whitelistFile --out ScasaOut_SRR10340946 — Reply to this email directly, view it on GitHub<#8 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AT4ASO5QNFCVLXJUZDDF3WTXGWYABANCNFSM6AAAAAAW55ORHY>. You are receiving this because you were mentioned.Message ID: ***@***.***>

from scasa.

nghiavtr commented on September 26, 2024

Hi @RenaeAtkinson ,

The first error of mkdir can be ignored, it is harmless
The second error indicates that the salmon alevin was not performed properly because no bfh.txt file exists, so yes this is the main issue.
I have no experience with running Salmon using conda, but usually we dont need conda to run Salmon. I also have not tried salmon version 1.10.1 that I am not sure if it has any changes in setting. I suggest you use the same salmon version as I have tested.

Nghia

from scasa.

So many Error messages: please help about scasa HOT 13 OPEN

Comments (13)

Related Issues (16)

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent