Software:Nvidia Parabricks

From HandWiki
Nvidia Parabricks
Developer(s)Nvidia
Stable release
4.3.1-1 / July 1, 2024
PlatformNvidia GPUs
Available inEnglish
TypeMedical software
Websitewww.nvidia.com/en-us/clara/genomics/

Parabricks company started at the University of Michigan by Mehrzad Samadi, Ankit Sethia, and Scott Mahlke. It was acquired by Nvidia in 2020.

Nvidia Parabricks is a suite of free software for genome analysis developed by Nvidia, designed to deliver high throughput by using graphics processing unit (GPU) acceleration.[1]

Parabricks offers workflows for DNA and RNA analyses and the detection of germline and somatic mutations, using open-source tools.[1] It is designed to improve the computing time of genomic data analysis while maintaining the flexibility required for various bioinformatics experiments.[1] Along with the speed of GPU-based processing, Parabricks ensures high accuracy, compliance with standard genomic formats and the ability to scale in order to handle very large datasets.[1]

Users can download and run Parabricks pipelines locally or directly deploy them on cloud providers, such as Amazon Web Services, Google Cloud, Oracle Cloud Infrastructure, and Microsoft Azure.[1]

Accelerated genome analysis fundamentals

Standard pipeline to extract variants from an individual's genome
Error creating thumbnail: Unable to save thumbnail to destination
Sequencing machines able to identify the sequence of bases constituting the DNA

The massive reduction in sequencing costs[2] resulted in a significant increase in the size and the availability of genomics data[3] with the potential of revolutionizing many fields, from medicine to drug design.[4]

Starting from a biological sample (e.g., saliva or blood), it is possible to extract the individual's DNA and sequence it with sequencing machinery to translate the biological information into a textual sequence of bases.[5] Then, once the entire genome is obtained through the genome assembly process, the DNA can be analyzed to extract information that is key in several domains, including personalized medicine and medical diagnostics.[6]

Typically, genomics data analysis is performed with tools based on Central Processing Units (CPUs) for processing.[7] Recently, several researchers in this field have underlined the challenges in terms of computing power delivered by these tools and focused their efforts on finding ways to boost the performance of the applications.[7] The issue has been addressed in two ways: developing more efficient algorithms or accelerating the compute-intensive part using hardware accelerators. Examples of accelerators used in the domain are GPUs, FPGAs, and ASICs[8]

In this context, GPUs have revolutionized genomics by exploiting their parallel processing power to accelerate computationally intensive tasks.[9][10] GPUs deliver promising results in these scenarios thanks to their architecture, composed of thousands of small cores capable of performing computations in parallel.[11] This parallelism allows GPUs to process multiple tasks simultaneously, significantly speeding up computations that can be broken down into independent units.[11] For instance, aligning millions of sequencing reads against a reference genome or performing statistical analyses on large genomic datasets can be completed much faster on GPUs than when using CPUs.[10] This facilitates the rapid analysis of genomic data from diverse sources, ranging from individual genomes to large-scale population studies,[12] accelerating the understanding of genetic diseases, genetic diversity, and more complex biological systems.[10]

Featured pipelines

Parabricks offers end users various collections of tools organized sequentially to analyze the raw data according to the user's requirements, called pipelines.[1] Nevertheless, users can decide to run the tools provided by Parabricks as a standalone, still exploiting GPU acceleration to overcome possible computational bottlenecks. Only some of the provided tools in the suite are GPU-based.[13]

Overview of the main steps of Nvidia Parabricks pipelines

Overall, all the pipelines share a standard structure. Most of the pipelines are built to analyze FASTQ data resulting from various sequencing technologies (e.g., short- or long-read). Input genomic sequences are firstly aligned and then undergo a quality control process. These two processes provide a BAM or a CRAM file as an intermediate result. Based on this data, the variant calling task that follows employs high-accuracy tools that are already widely used. As output, these pipelines provide the identified mutations in a VCF (or a gVCF).[13]

Germline pipeline

The germline pipeline offered by Parabricks follows the best practices[14] proposed by the Broad Institute in their Genome Analysis ToolKit (GATK).[15] The germline pipeline operates on the FASTQ files provided as input by the user to call the variants that, belonging to the germ line, can be inherited.[13]

This pipeline analyzes data computing the read alignment with BWA-MEM[16][17] and calling variants using GATK HaplotypeCaller,[18] one of the most relevant tools in the domain for germline variant calling.[13]

DeepVariant germline pipeline

Besides the pipeline that resorts to HaplotypeCaller to call variants, Parabricks also offers an alternative pipeline that still calls germline variants but is based on DeepVariant.[19][20] DeepVariant is a variant caller, developed and maintained by Google, capable of identifying mutations using a deep learning-based approach. The core of DeepVariant[19] is a convolutional neural network (CNN) that identifies variants by transforming this task into an image classification operation. In Parabricks, the inference process is accelerated in hardware. For this pipeline, only T4, V100, and A100 GPUs are supported.[13]

Analyses performed according to this pipeline are compliant with the use of BWA-MEM[16] for the alignment by Google's CNN for variant calling.[13]

Human_par pipeline

Still compliant with GATK best practices,[14] the human_par pipeline allows users to identify mutations in the entire human genome, including sex chromosomes X and Y, and, thus, it is compliant with their ploidy. For male samples, firstly, the pipeline runs HaplotypeCaller[18] on all the regions that do not belong to the X and Y chromosomes and on the pseudoautosomal region with ploidy equal to 1. Then, HaplotypeCaller analyses the X and Y regions without the pseudoautosomal region with ploidy 2. Regarding female samples, instead, the pipeline runs HaplotypeCaller on the entire genome, with ploidy 2.[13]

The sex of the sample can be determined in two main ways:

  1. Manually set with the --sample-sex option;
  2. Specify the X vs. Y ratio with range options --range-male and --range-female and let the tool automatically infer the sex of the samples based on the X and Y reads count.

The pipeline requires the user to specify at least one of these three options.[13]

As for the germline case, since this pipeline targets the germline variants, the pipeline resorts to BWA-MEM[16] for the alignment, followed by HaplotypeCaller[18] for variant calling.[13]

Somatic pipeline

Parabricks' somatic pipeline is designed to call somatic variants, i.e., those mutations affecting non-reproductive (somatic) cells. This pipeline can analyze both tumor and non-tumor genomes, offering either tumor-only or tumor/normal analyses for comprehensive examinations.[13]

As in the germline pipeline, the alignment task is carried out using BWA-MEM[16] followed by GATK Mutect[21] to identify the possible mutations. Mutect is used instead of HaplotypeCaller due to its focus on somatic mutations, as opposed to germline mutations targeted by HaplotypeCaller.[21]

RNA pipeline

This pipeline is optimized for short variant discovery (i.e., Single-nucleotide polymorphisms (SNPs) and indels) in RNAseq data. It follows the Broad Institute's best practices for these types of analyses.[13]

It relies on the STAR aligner,[22] a read aligner specialized for RNA sequences for aligning the reads, and HaplotypeCaller[18] for calling variants.[13]

Parabricks tools

Parabricks provides a collection of tools to perform genomics analyses, classified into six main categories related to their task.[13] These tools combined constitutes Parabricks' pipelines, and can be also used as-is.

For FASTQ and BAM files processing, the proposed tools are:[13]

  • applybsqr
  • bam2fq
  • bamsort
  • bqsr
  • fq2bam
  • fq2bamfast
  • fq2bam_meth
  • markdup
  • minimap2 (beta)

For calling variants, the proposed tools are:[13]

  • deepsomatic
  • deepvariant
  • deepvariant_germline
  • germline (GATK Germline Pipeline)
  • haplotypecaller
  • mutectcaller
  • pacbio_germline (beta)
  • postpon
  • prepon
  • somatic (Somatic Variant Caller)

For RNA processing, the proposed tools are:[13]

  • rna_fq2bam
  • starfusion

For results quality control, the proposed tools are:[13]

  • bammetrics
  • collectmultiplemetrics

For processing variants, the proposed tools are:[13]

  • dbsnp

For processing gVCF files, the proposed tools are:[13]

  • genotypegvcf
  • indexgvcf

Not all the listed tools are accelerated on GPU.[13]

Hardware support

Users can download and run Parabricks pipelines on their local servers, allowing for private, on-site data processing and analysis. They also can deploy Parabricks pipelines on cloud platforms, with improved scalability for larger datasets. Supported cloud providers include AWS, GCP, OCI, and Azure.[1]

In the latest release (v4.3.1-1), Parabricks includes support for the Nvidia Grace Hopper super chip.[23] The Nvidia GH200 Grace Hopper Superchip is a heterogeneous platform designed for high-performance computing and artificial intelligence, combining an Nvidia Grace and a Hopper on a single chip.[24] This platform enhances application performance using both GPUs and CPUs, offering a programming model aimed at improving performance, portability, and productivity.[23]

Applications

Due to the computational power required by genomics workloads, Parabricks has found application in several research studies with different applicative domains, especially in cancer research.[25][26][27]

Scientists from Washington University used the Parabricks DeepVariant pipeline for identifying variants (e.g., SNPs and small indels) in long-read Hi-Fi whole-genome sequencing (WGS) data generated with PacBio's Revio SMRT Cell technology.[28]

In addition to the pipelines, individual components of Parabricks have been used as standalone tools in academic settings. For example, the accelerated DeepVariant has been employed in a novel process to reduce the processing time further for WGS Nanopore data.[29]

In 2022, Nvidia announced a collaboration with the Broad Institute to provide researchers with the benefits of accelerated computing. This partnership includes the entire suite of Nvidia's biomedical hardware-accelerated software suite called Clara, that includes Parabricks and MONAI.[30] Similarly, the Regeneron Genetics Center uses Parabricks to expedite the secondary analysis of the exomes they sequence in their high-throughput sequencing center, leverage the DeepVariant Germline pipeline inside their workflows.[31]

See also

References

  1. 1.0 1.1 1.2 1.3 1.4 1.5 1.6 "Clara for Genomics". https://www.nvidia.com/en-us/clara/genomics/. 
  2. "DNA Sequencing Costs: Data" (in en). https://www.genome.gov/about-genomics/fact-sheets/DNA-Sequencing-Costs-Data. 
  3. "Cloud computing for genomic data analysis and collaboration". Nature Reviews. Genetics 19 (4): 208–219. April 2018. doi:10.1038/nrg.2017.113. PMID 29379135. 
  4. "Genetics, genomics, and their relevance to pathology and therapy". Best Practice & Research. Clinical Rheumatology. Advances in Paediatric Rheumatology and Translation of Research to Targeted Therapies 28 (2): 175–189. April 2014. doi:10.1016/j.berh.2014.05.001. PMID 24974057. 
  5. "From molecules to genomic variations: Accelerating genome analysis via intelligent algorithms and architectures". Computational and Structural Biotechnology Journal 20: 4579–4599. 2022. doi:10.1016/j.csbj.2022.08.019. PMID 36090814. 
  6. "Basics of Personalized Medicine" (in en). Textbook of Personalized Medicine. New York, NY: Springer. 2009. pp. 1–27. doi:10.1007/978-1-4419-0769-1_1. ISBN 978-1-4419-0769-1. 
  7. 7.0 7.1 "Accelerating Genome Analysis: A Primer on an Ongoing Journey". IEEE Micro 40 (5): 65–75. September 2020. doi:10.1109/MM.2020.3013728. ISSN 0272-1732. https://ieeexplore.ieee.org/document/9154510. 
  8. "Technology dictates algorithms: recent developments in read alignment". Genome Biology 22 (1): 249. August 2021. doi:10.1186/s13059-021-02443-7. PMID 34446078. 
  9. "Scaling computational genomics to millions of individuals with GPUs". Genome Biology 20 (1): 228. November 2019. doi:10.1186/s13059-019-1836-7. PMID 31675989. 
  10. 10.0 10.1 10.2 "Graphics processing units in bioinformatics, computational biology and systems biology". Briefings in Bioinformatics 18 (5): 870–885. September 2017. doi:10.1093/bib/bbw058. PMID 27402792. 
  11. 11.0 11.1 (in en) Professional CUDA C Programming. John Wiley & Sons. 2014-09-09. ISBN 978-1-118-73932-7. https://books.google.com/books?id=q3DvBQAAQBAJ&dq=professional+cuda+c+programming&pg=PR17. 
  12. "gPGA: GPU Accelerated Population Genetics Analyses". PLOS ONE 10 (8): e0135028. 2015-08-06. doi:10.1371/journal.pone.0135028. PMID 26248314. Bibcode2015PLoSO..1035028Z. 
  13. 13.00 13.01 13.02 13.03 13.04 13.05 13.06 13.07 13.08 13.09 13.10 13.11 13.12 13.13 13.14 13.15 13.16 13.17 13.18 13.19 "Welcome to NVIDIA Parabricks v4.3.1" (in en). https://docs.nvidia.com/clara/parabricks/latest/index.html. 
  14. 14.0 14.1 "Best Practices for Variant Calling with the GATK" (in en). 2015-03-19. https://www.broadinstitute.org/partnerships/education/broade/best-practices-variant-calling-gatk-1. 
  15. "Genome Analysis Toolkit (GATK)" (in en). 2010-06-08. https://www.broadinstitute.org/scientific-community/software/genome-analysis-toolkit-gatk. 
  16. 16.0 16.1 16.2 16.3 Aligning sequence reads, clone sequences and assembly contigs with BWA-MEM, 2013-05-26 
  17. "Burrows-Wheeler Aligner". https://bio-bwa.sourceforge.net/. 
  18. 18.0 18.1 18.2 18.3 (in en) Scaling accurate genetic variant discovery to tens of thousands of samples, 2018-07-24, doi:10.1101/201178, https://www.biorxiv.org/content/10.1101/201178v3, retrieved 2024-07-09 
  19. 19.0 19.1 "A universal SNP and small-indel variant caller using deep neural networks". Nature Biotechnology 36 (10): 983–987. November 2018. doi:10.1038/nbt.4235. PMID 30247488. 
  20. google/deepvariant, Google, 2024-07-04, https://github.com/google/deepvariant, retrieved 2024-07-09 
  21. 21.0 21.1 "Sensitive detection of somatic point mutations in impure and heterogeneous cancer samples". Nature Biotechnology 31 (3): 213–219. March 2013. doi:10.1038/nbt.2514. PMID 23396013. 
  22. "STAR: ultrafast universal RNA-seq aligner". Bioinformatics 29 (1): 15–21. January 2013. doi:10.1093/bioinformatics/bts635. PMID 23104886. 
  23. 23.0 23.1 "Grace Hopper Superchip" (in en). https://docs.nvidia.com/clara/parabricks/latest/GraceHopper.html. 
  24. "First Impressions of the NVIDIA Grace CPU Superchip and NVIDIA Grace Hopper Superchip for Scientific Workloads". Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region Workshops. HPCAsia '24 Workshops. New York, NY, USA: Association for Computing Machinery. 2024-01-11. pp. 36–44. doi:10.1145/3636480.3637097. ISBN 979-8-4007-1652-2. https://doi.org/10.1145/3636480.3637097. 
  25. "Abstract 165: Enhanced processing of genomic sequencing data for pediatric cancers: GPUs and machine learning techniques for variant detection" (in en). Cancer Research 81 (13_Supplement): 165. July 2021. doi:10.1158/1538-7445.AM2021-165. ISSN 0008-5472. https://aacrjournals.org/cancerres/article/81/13_Supplement/165/667493/Abstract-165-Enhanced-processing-of-genomic. 
  26. "de novo variant calling identifies cancer mutation signatures in the 1000 Genomes Project". Human Mutation 43 (12): 1979–1993. December 2022. doi:10.1002/humu.24455. PMID 36054329. 
  27. "Genomic landscape of locally advanced rectal adenocarcinoma: Comparison between before and after neoadjuvant chemoradiation and effects of genetic biomarkers on clinical outcomes and tumor response". Cancer Medicine 12 (14): 15664–15675. July 2023. doi:10.1002/cam4.6169. PMID 37260182. 
  28. "High Coverage Highly Accurate Long-Read Sequencing of a Mouse Neuronal Cell Line Using the PacBio Revio Sequencer". bioRxiv. June 2023. doi:10.1101/2023.06.06.543940. PMID 37333171. 
  29. "Accelerated identification of disease-causing variants with ultra-rapid nanopore genome sequencing". Nature Biotechnology 40 (7): 1035–1041. July 2022. doi:10.1038/s41587-022-01221-5. PMID 35347328. 
  30. "The Broad Institute and NVIDIA Bring NVIDIA Clara to Terra Cloud Platform Serving 25,000 Researchers Advancing Biomedical Discovery" (in en-us). http://nvidianews.nvidia.com/news/the-broad-institute-and-nvidia-bring-nvidia-clara-to-terra-cloud-platform-serving-25-000-researchers-advancing-biomedical-discovery. 
  31. "UK Biobank Advances Genomics Research with NVIDIA Clara Parabricks" (in en). https://resources.nvidia.com/en-us-hc-genomics/uk-biobank. 

Further reading

External links