Skip to content

Bulk RNA sequencing FAQs

RNA sequencing (RNA-seq) has become a powerful method in transcriptomics, allowing highly accurate gene expression quantification. It is providing researchers with visibility into previously undetected changes occurring in disease states, in response to therapeutics, under different environmental conditions, and across a broad range of other study designs.

How is a Bulk RNA-seq dataset on Polly defined?

Bulk RNA-Seq Datasets on Polly represent a curated collection of biologically and statistically comparable samples. All the datasets are denoted using a unique ID, which follows the GEO record identifier format comprising a series ID and a platform ID.

  • Platform record - A Platform record is composed of a summary description of the array or sequencer. Each Platform record is assigned a unique GEO Identifier ( GPLxxx )
  • Series record - A Series record links together a group of related samples and provides a focal point and description of the whole study. Each Series record is assigned a unique GEO Identifier ( GSExxx ). A Series record can be of two types - SubSeries and SuperSeries. For bigger experiments, there are both SubSeries and SuperSeries. SuperSeries is all the experiments for a single paper/study. SuperSeries can be divided into SubSeries which are different technologies. In the GEO Transcriptomics OmixAtlas, we only have Subseries records.

For example, dataset ID 'GSE189190_GPL25947_raw' would translate to:

  • sequenced using the platform ID- GPL25947
  • from the Series GSE189190
  • Here _ raw signifies 'raw counts' for datasets

How are Bulk RNA-seq datasets stored on Polly

All datasets are available with raw counts data matrix and associated metadata. The datasets are available in GCT (Gene Cluster Format) file format which allows for storing sample metadata as well as the expression data in a single file.

Which pipeline is used for processing the Bulk RNASeq data?

All Bulk RNA-Seq Datasets on Polly are processed using a Kallisto pipeline. The data is processed with the following reference genome, annotation, and complementary DNA sequence data from Ensembl release 107 for each organism.

Note: approximately 12% of datasets on the Bulk RNA-Seq OmixAtlas are currently processed with the Ensemble release V90. These will be reprocessed based on the Ensemble release V107 in future versions

  1. Homo Sapiens Ensembl release 107, 90
  2. Genome sequence (fasta)
  3. Mus musculus Ensembl release 107, 90
  4. Genome sequence (fasta)
  5. Rattus norvegicus Ensembl release 107, 90
  6. Genome sequence (fasta) Process flow

Process flow

Figure 1. Process Flow

Details of the processing steps:

  1. Detect organisms and fetch relevant genome, annotation, and complementary DNA sequence data from Ensembl.
  2. Download the transcriptome sequencing data (.sra files) from SRA using sratoolkit prefetch / AWS S2 URI if publicly available.
  3. Validate the downloaded .sra file using vdb-validate.
  4. Identify if the SRA data is (single-end) or (paired-end)using fastq-dump. Both single-end (SE) and paired-end (PE) sequencing data are processed with the exclusion of color-space sequence data.
  5. Extract fastq files with parallel-fastq-dump.
  6. Perform basic quality control checks on the .fastq reads using FastQC. (Diagnose basespace / colorspace, quality encoding, read length)
  7. Trim Bases with phred quality \<10 on the 3′ ends and discarded reads shorter than 18 nucleotides using Skewer.
  8. Transcript-level expression counts are generated using Kallisto by mapping all the reads that pass quality control to the genome. Command: "kallisto quant" . All counts are reported on the gene level by taking a simple sum of Transcript-level counts. (NOTE: Kallisto pseudo counts are rounded to integer values)
  9. A Multiqc report is generated that compiles all fastqc, kallisto and skewer output into a single report.
  10. For every SRR accession, the generated counts are collected into a single (.gct) file and multiple SRR counts per GSM ID (sample) are aggregated.
  11. At the feature level, the Ensembl gene IDs are mapped to the respective HGNC symbol, MGI Symbol or RGI symbol. Counts for duplicate genes are dropped using Mean Average Deviation Score.
  12. Each sample is then annotated with relevant metadata using Polly’s curation models for a standard fields disease, tissue, cell line, drug, cell type, organism.
  13. If requested, the counts matrix is normalized using DESeq2 VST (Variance Stabilizing Transformation).
  14. GCT having Raw Counts are pushed to the Omix Atlas - Bulk RNASeq OmixAtlas.

Tools Used for the processing:

Tool Task Usage
1 GEOparse Query GEO and fetch sample IDs (GSMs).
2 pySRAdb Query SRA and fetch run IDs corresponding to sample IDs (GSMs) and create GSM: SRR mappings.
3 SRA toolkit Download SRA files prefetch SRRXXXXXX
4 SRA toolkit Validate downloaded SRA files vdb-validate
5 SRA toolkit diagnose single or paired-end fastq-dump
6 SRA toolkit Rapid decompression of sequence data from .sra files Fasterq-dump
7 FastQC Diagnose basespace / colorspace, quality encoding, read length fastqc
8 Skewer Trim Bases with phred quality <10 on the 3′ ends and discard reads shorter than 18 nucleotides skewer
9 Kallisto Transcript-level mapping Kallisto quant
10 Multiqc Compiles all fastqc, kallisto and skewer output into a single report Multiqc
11 Internal script for sample aggregation Collect transcript counts, and sample metadata, make counts matrix, and then make a GCT file
12 GEO Curation pipeline Curate sample and dataset level information and attach it to the GCT file

Do you currently provide or plan to provide alternatives to bulk RNAseq processing?

We process the bulk RNAseq datasets using the Kallisto pipelines as it is less computationally demanding and has been shown to perform as well as the STAR pipeline Reference. If required, we can also process the datasets you purchase using STAR or any other custom pipeline of choice at additional cost. This will be considered a custom pipeline service.

Which fields are curated for bulk RNASeq data Data?

Polly's NLP-based curation models are used to curate all datasets and their corresponding samples, which are then harmonised using specific biomedical ontologies. These fields include - Organism, Disease, Tissue, Cell Line, Cell Type and Drug. In addition to these fields, various other metadata fields are captured from the source publication and annotated at 3 levels:

  • Dataset-level metadata - General information about the experiment, subject and transformations, for eg, organism, experiment type, and disease under study.
  • Sample-level metadata - Captures information for each sample. Eg. Drug, tissue
  • Feature-level metadata: Provides molecular/gene information that is consistent across samples.

Detailed list of curated fields could be accessed here.

Are all metadata fields from the source retained?

All metadata fields from the source publication are captured in the GCT file and can be visualized on the details page of a dataset ID or through applications. However, only the fields described in the OmixAtlas schema are available for querying via Polly Python.

Can users request for datasets on Polly?

Bulk RNASeq datasets from GEO which are not available on Polly can be requested to be added to a user's OmixAtlas. Upon request, these datasets will be added directly to your atlas within 4 days. The following requests are in scope:

  • Raw data files (fastq) are available on GEO
  • The datasets are specific to the organisms - Human, mouse and rat
  • The dataset belongs to the Bulk RNA-Seq data type