Skip to main content

PIPEBAR and OverlapPER: tools for a fast and accurate DNA barcoding analysis and paired-end assembly

Abstract

Background

Taxonomic identification of plants and insects is a hard process that demands expert taxonomists and time, and it’s often difficult to distinguish on morphology only. DNA barcodes allow a rapid species discovery and identification and have been widely used for taxonomic identification by targeting known gene regions that permit to discriminate these species. DNA barcode sequence analysis is usually carried out with processes and tools that still demand a high interaction with the user or researcher. To reduce at most such interaction, we proposed PIPEBAR, a pipeline for DNA chromatograms analysis of Sanger platform sequencing, ensuring high quality consensus sequences along with efficient running time. We also proposed a paired-end reads assembly tool, OverlapPER, which is used in sequence or independently of PIPEBAR.

Results

PIPEBAR is a command line tool to automatize the processing of large number of trace files. It is accurate as the proprietary Geneious tool and faster than most popular software for barcoding analysis. It is 7 times faster than Geneious and 14 times faster than SeqTrace for processing hundreds of barcoding sequences. OverlapPER is a novel tool for overlapping paired-end reads accurately that accepts both substitution and indel errors and returns both overlapped and non-overlapped regions between a pair of reads. OverlapPER obtained the best results compared to currently used tools when merging 1,000,000 simulated paired-end reads.

Conclusions

PIPEBAR and OverlapPER run on most operating systems and are freely available, along with supporting code and documentation, at https://sourceforge.net/projects/PIPEBAR/ and https://sourceforge.net/projects/overlapper-reads/.

Background

Advances in DNA sequencing approaches have produced an overwhelming volume of data, followed by new data analysis software and pipelines. Next generation sequencing (NGS) platforms have been used on a wide variety of omics studies for biodiversity assessment but the traditional Sanger method is still broadly used, including genetic testing [1] and DNA barcode generation [2,3,4]. DNA barcoding is an important molecular methodology based in a short standardized polymorphic sequence capable of distinguishing species. This approach is widely employed in biodiversity studies to identify and classify the diversity of well-known species or unexplored groups [4,5,6], evaluate inter- and intra-species variations [6,7,8], detect cryptic species or join genetically similar but morphologically distinct species [5, 7,8,9]. Also, DNA barcoding has been proposed for forensic identification and development of DNA reference library, since the lack of a reliable DNA barcoding reference library is the main barrier to its application [2] Sanger technology has been widely used for aiding morphological species identification because is a useful tool for identifying genetically distinct units worthy of more intense taxonomic study [3, 7,8,9] and creation of reference database, such as BOLD [10]. In these cases, there are necessity of sequencing of individual specimens using genome regions in order to infer evolutionary differences and identification only [5].

The universal barcode locus used for discriminating animal species is the 5′ region of the mitochondrial cytochrome c oxidase I (COI) gene [8]. For plants, the markers of choice are the large subunit of RuBisCo (rbcL) and maturase (matK) adopted as standards, but other markers are also used [11, 12]. The combination of coding genes (matK, rbcL, rpoB, ycf1 and rpoC1), noncoding spacers (atpF–atpH, trnH–psbA, and psbK–psbI) and the nuclear-encoded ribosomal internal transcribed spacer (ITS2) is highly recommended to obtain an adequate species discrimination for plants [13,14,15,16]. The success of DNA barcoding for evolutionary studies depends on an accurate selection of theses molecular markers, once distinct species group show distinct speciating taxa, retention of ancestral polymorphism and hybridization [17]. Therefore, Bioinformatics plays a key role in supporting and consolidating DNA barcoding efforts, from choosing the PCR primers to evaluating sequence quality and subsequent data analysis [18].

Several visualization tools are available for Sanger sequencing (4Peaks v1.8 [19], Chromas v2. 6.5 [20], Finch TV v1.5.0 [21], GLASS v0.4.3 [22], Geneious R11, CLCBio v11 [23], bioedit [24], SeqTrace v0.9.0 [25] and Sequencher v5.4. 6 [26]), however, few are intended for DNA barcode analysis (quality check, filtering, reads overlapping and format conversion). SPIDER [27], ClinQC [28], and SeqTrace were developed for Sanger sequenced analyses and are freely available.. SPIDER was developed exclusively for downstream analysis, so it cannot assemble barcoding sequences. It allows the calculation of both standard summary statistics (number of species, number of individuals, number of haplotypes per species, lengths of sequences, the proportion of missing data) and tests of DNA barcode data (barcode gap). ClinQC is a workflow developed in Python indicated for pre-processing, quality control and format conversion for Sanger and NGS data, however, it does not generate the consensus sequence from matching forward and reverse sequencing reads. SeqTrace allows the execution of all DNA barcode analysis steps, although the batch processing of several trace files cannot be executed in a concise command line (aka shell mode) and many mismatches and gaps are generated in building the consensus sequences. Geneious, CLCBio and Sequencher are proprietary softwares able to perform many types of analysis, from sequence alignment and assembly to phylogenetic trees generation, and can also be used to analyze Sanger DNA barcode sequences, but they are commercial softwares and they also cannot handle batch processing from the command line.

Here we introduce PIPEBAR, an automated, fast and accurate pipeline for Sanger sequenced DNA barcode data analysis. PIPEBAR wraps other freely available software, converting ABI files to fastq files ensuring a correct base call and a good quality content; it includes an additional step for high accuracy assembly of the paired reads (forward and reverse) based in a new assembly method, OverlapPER, that merges overlapping paired-end reads considering both indels and substitutions, returning both the overlapped and non-overlapped regions. We also make available an additional step for stop-codons and frameshift corrections for the final sequences assembled by PIPEBAR that are originated from coding regions, facilitating the submission of such sequences to barcode databases, such as BOLD and NCBI [29]. All these steps can be executed using one single command line, facilitating the batch-processing of many trace files. Batch processes using more than 800 sequence trace files on a single execution was faster in our pipeline than any other tool in our benchmark comparison. We used the commercial software Geneious (Version R10) as a reference tool for the comparison analysis.

The further sessions of the paper are organized as it follows: Implementation, where we show how PIPEBAR and OverlapPER operate; Results and Discussion, where we tested both PIPEBAR and OverlapPER and showed the obtained results, along with its discussion; and Conclusion, where we summarize the tools presented and how important they can be to the scientific community.

Implementation

In the following sections, we show how both PIPEBAR and OverlapPER were implemented.

PIPEBAR pipeline

PIPEBAR was developed in a shell script for Unix-based operating systems (Linux and iOS) that organizes all the fundamental steps for obtaining high-quality barcode sequences. Figure 1 shows the PIPEBAR workflow, and all the steps will be described in detail.

Fig. 1
figure 1

PIPEBAR workflow. a, b Conversion of chromatograms files to FASTQ files. c, ) Trimming and filtering of the FASTQ files for low quality bases based on Phred quality. e Overlapping paired-end reads considering both substitution and indel errors by OverlapPER. f report file of barcode sequences produced given a PHRED quality value as parameter. g Fasta files for the merged reads and FASTQ files for the not-merged reads. h In case of analyzing a coding region, PIPEBAR applies stop codon and frameshift correction

At the end of the Sanger sequencing process, the output files are the ab1 and phd.1 file formats, also known as chromatograms (Fig. 1a). The initial step is converting the ab1 files to FASTQ files carried out using the EMBOSS framework [30]. The FASTQ files contain all the DNA sequences from the submitted samples along with their respective base qualities that need to be evaluated and considered in other downstream processes. After the conversion (Fig. 1b), the FASTQ files are submitted to trimming (Fig. 1c) and filtering (Fig. 1d), given a set of quality parameters (default is: minimum quality score = 20), using PRINSEQ [31]. The trimming process will discard both 5′ and 3′ ending if their mean quality score is below PHRED 20, given a sliding window(−trim_qual_window parameter) of 10 basepairs at a step size (−trim_qual_step) of 1 basepair. In the filtering process, PRINSEQ will discard all the sequences whose mean quality score (−min_qual_mean) is below PHRED 20 and length is less than 50 bp. We assemble the resulting high quality pair of sequences using an in-house developed python script, named OverlapPER, that merges the forward and reverse sequences, given a minimum overlap length (default is 25 bp), similarity (default is 90%) and gap size (default is maximum of 5 gaps opening) (Fig. 1e).

PIPEBAR generates as the final output a fasta file containing all the high-quality consensus sequences that passed the quality treatment and fulfilled the conditions of minimum overlap length and minimum overlap similarity to be merged (Fig. 1g). Sequences that do not pass through the quality evaluation as well as those that could not be merged are not discarded. They are kept in other files for possible further curation and inspection. PIPEBAR also generates quality reports (Fig. 1 and in Additional file 1: Figure S3), allowing visualization of the quality values of the barcode sequences bases by specifying a threshold of the minimum accepted PHRED value. With this report, the user will be able to check if there is some potential problematic barcodes and, if re-sequencing is needed.

When it comes to barcode analysis, usually the submission of the obtained barcodes in public databases, such as BOLD, is needed. The submission of barcode data is made with nucleotide and, in case of a coding region, protein sequences. To facilitate this submission, when the barcode is originated from a coding region, downstream analyses using the fasta files were implemented to evaluate stop codons and frameshifts that might happen in the protein translation. For this step, a python script was developed to detect the stop codons and execute correction steps based on the reading six frames of translation to aminoacids. The frameshift correction will be performed on the FASTA file output if the user specifies that the barcodes are from coding regions, otherwise the translation, frameshift and stop-codon correction are not needed (Fig. 1h).

In Fig. 2 we demonstrate how the correction of stop codons and frameshifts works on PIPEBAR when the barcode is originated from a coding region. When the final output is generated, PIPEBAR will at first certify that the sequence are in the forward sense (comparing with the forward read given as input) and then will translate the nucleotide sequences to protein, according to the translation table specified by the user (default is translation Table 1 (standard)). PIPEBAR considers all the frames of translation and will choose the frame which contains the largest ORF. The chosen frame will have the 5′ and 3′ regions trimmed where the stop codons appears, resulting in the corrected ORF and respective DNA sequence.

Fig. 2
figure 2

Stop-codon and frameshift corrections. PIPEBAR translates the sequence in 3 forward and 3 reverse frames, selects the frame where the impact of the found stop codons is minimum. Identifying the best translation frame, the stop codons located in the extremities of the sequence are trimmed, generating at the end of the process a sequence that is ready to be submitted to NCBI and BOLD databases

Table 1 Comparison of PIPEBAR to SeqTrace and Geneious regarding to the total of barcodes produced at the end of the pipeline execution for the 3 datasets, mean similarity percentage of all the resulting barcodes to its respective Bold reference sequence, the time spent for each pipeline counting from sequences trimming to the final results, total sum of mismatches and gap openings by applying Blastn [44] against the FASTA of ab1 files retrieved from Bold

PIPEBAR is an easy-to-use pipeline and can be used by bioinformaticians and biologists in two different ways: through a Docker environment, where the user only needs to download the PIPEBAR Docker environment (see Additional file 1) without worrying about its dependencies. The Docker environment will facilitate the use of PIPEBAR for those who do not want to install all the tools that are necessary for PIPEBAR to run properly. It is also possible to install all the dependencies of PIPEBAR separately, as shown in the Additional file 1.

OverlapPER assembler

There are plenty of open-source tools for merging overlapping paired-end reads. and BBMerge v38.01 [32] and FLASH v1.2.11 [33] merges reads admitting substitution errors, but doesn’t handle indels. leeHom [34] also accepts only substitution error, returning only the overlapped region while merging two sequences, discarding the extremities. COPE v1.1.2 [35] and PEAR v0.9.8 [36] consider both indels and substitution errors in the assembly. However, COPE requires the kmer frequency of reads to consider indels, while PEAR trims the 5′ and 3′ sequence extremities. PANDAseq [37] is recommended to be used on Illumina sequences, demanding even that the identifier of the reads in the FASTQ file be in the Illumina format. Geneious R10 merges paired-end reads considering both indels and substitution errors, returning both overlapped and non-overlapped sequence regions, but it requires a significant amount of RAM and CPU power and it is a commercial software. To cover the gaps indicated we created OverlapPER, an open source tool that merges overlapping paired-end reads considering both indels and substitutions, returning both the overlapped and non-overlapped regions. OverlapPER may be used in sequences originated from any sequencing platform, demanding only that the pair of sequences do overlap.

OverlapPER was implemented in Python and can be executed in any operational system supporting Python 3+. It is a script for building the consensus sequences considering indels by inserting a gap in case of a mismatch and evaluates if the insertion optimizes the alignment. In case of a true mismatch, it chooses the base that has the higher quality value. OverlapPER requires as input two fastq files, containing the forward and reverse sequences in the same order in both files. Minimum accepted overlap length and the minimum similarity percentage of the overlapped region are obligatory parameters to run OverlapPER. Figure 3 exemplifies the merging of two reads (Fig. 3a) and the result (Fig. 3c). In this example, there were 8 initial mismatches (Fig. 3b, nucleotides in red) and the result obtained by OverlapPER contained only 1 mismatch and 1 gap opening (Fig. 3c, gap opening represented as a “_”).

Fig. 3
figure 3

Merging process for paired-end reads. a OverlapPER script first finds a seed (a short sequence in one of the reads represented in bold) (b) The reads are positioned according to the seed found and the total overlap is determined. c The total overlap is analyzed. If there is a hit in the alignment, the identity score is incremented. If a base is aligned to a gap, the identity score is incremented. In case of a mismatch in the alignment, if the next 5 bases (tolerance) are identical, the mismatch score is incremented, otherwise a gap insertion is repeated 4 times until the next 5 bases are identical. Nucleotides in bold represent a hit in the alignment

If a generic base (N) is found in a overlapping region, OverlapPER will consider the base of the other sequence, otherwise, it will keep the generic base.

The overall algorithm of OverlapPER is as follows:

  1. 1.

    Finds a seed at the end of the first read (Fig. 3a);

  2. 2.

    Repeat if a seed is not shared between the read-pairs:

    1. 2.1

      Another seed is found in the first read, by sliding the seed window given a seed_step parameter;

  3. 3.

    The total overlap is determined considering the seed shared between the reads (Fig. 3b);

  4. 4.

    Repeat until all the bases from the total overlap are analyzed (Fig. 3c):

    1. 4.1

      If there is a hit in the alignment, the identity score is incremented;

    2. 4.2

      If a base is aligned to a gap, the identity score is incremented;

    3. 4.3

      If there is a mismatch in the alignment:

      1. 4.3.1

        If the next 5 bases (tolerance) are identical, the mismatch score is incremented;

      2. 4.3.2

        Else, repeat gap openings 4 times (repeat), until the next 5 bases are identical.

  5. 5.

    If the overlap length and the identity percentage fulfill the minimum requisites, the read-pairs are merged, generating a consensus sequence (Fig. 3d)

Seed_length, seed_step, tolerance and repeat parameters can be configured and have their default values equals to 16 bp, 12 bp, 5 bp and 4, respectively. Seminal works on the problem of deriving the consensus sequence are in [38,39,40].

OverlapPER is also available for use independently of PIPEBAR assuming that the intention will be only to merge paired-end reads (https://sourceforge.net/projects/overlapper-reads/).

Results and discussion

PIPEBAR results

To evaluate the performance and efficiency of PIPEBAR, we submitted 3 different datasets which included: a set of 436, 260 and 145 pairs of trace files (totalizing 841 pairs) corresponding to plant marker genes (rbcL, ITS2 and matK, respectively); 559 pairs of trace files for COI (animal marker gene) and another set with 490 pairs of trace file for fungal ITS. The forward and reverse trace files used as input were downloaded from the BOLD database and can be obtained at https://sourceforge.net/projects/pipebar/files/TraceFiles/. We compared the results of PIPEBAR to SeqTrace (Version 0.9.0) and Geneious (Version R10) (our benchmark), as shown in Table 1. PIPEBAR and Geneious were executed with the same parameters of minimal overlap length (25 bp), minimal similarity percentage (90%) and error probability threshold (1%). SeqTrace does not use the overlap technique to assemble its sequences, it makes use of a Bayesian inference to build the consensus sequence. For our comparison study, SeqTrace was executed with its default settings (consensus algorithm = Bayesian and a minimum confidence score = 20) which is a setting recommended by SeqTrace’s developers and authors. Table 1 shows the results obtained by running PIPEBAR, SeqTrace and Geneious in a six-core 1.9 GHz Intel Xeon computer with 32 GB of RAM, running Ubuntu 16.04 LTS.

In all the 3 datasets, PIPEBAR had the best run time results, being in average 7 times faster than Geneious and 14 times faster than SeqTrace. It also reported higher accuracy with respect to the assembled barcode sequences regarding the mean % identity when aligned to the BOLD reference sequences, being better than SeqTrace with a slightly disadvantage in comparison to Geneious (Table 1). SeqTrace obtained the highest number of resulting barcodes because it cannot consider a minimum overlap length, so it assembled pairs of sequences even if they did not share an overlapping region. Therefore, some of its resulting barcodes had a low-quality confidence (Fig. 4). Additionally, the high number of mismatches and gaps (Table 1) obtained by SeqTrace poses problems to tree-building algorithms, making sequences appear less related than they are, forcing related sequences into different clades as a high number of mismatches and gaps will directly influence biodiversity and phylogenetic downstream analysis [41].

Fig. 4
figure 4

Example of an erroneous sequence generated by SeqTrace. Sequences PCCMN351-FWD and PCCMN351-REV are the trimmed sequences that should overlap, originated from the Dataset 1. SeqTrace erroneously insert gaps (from base 100 to 500) that connect the two sequences without having any insert distance information. The figure was generated using Geneious by aligning the PCCMN351-FWD and PCCMN351-REV sequences to its respective barcode generated by SeqTrace. The qualities of the forward and reverse sequences are demonstrated as a histogram. As SeqTrace does not generate a FASTQ file, we could not evaluate the quality of the barcode generated

The erroneously assembled sequences decreased the accuracy of SeqTrace’s produced barcodes. The number of mismatches and gap openings of PIPEBAR sequences were significantly better than SeqTrace sequences and slightly inferior in comparison to Geneious results. Unlike Geneious, that uses the highest signal of the chromatogram trace files in base calling process, the EMBOSS tools used by PIPEBAR calls a generic base (N) in case of discordance of the signals in a base with low quality, thus ensuring the confidence of the bases generated during basecalling.

SeqTrace obtained a mean sequence length greater than PIPEBAR and Geneious. However, upon closer inspection, one can observe that the sequences were indeed erroneously assembled sequences (Fig. 4).

To show why PIPEBAR did not assemble some sequences, we chose the results obtained from the Dataset 1. A total of 11 pairs of sequences were not assembled by PIPEBAR and Geneious. In Table 2, we show that our assembly criteria (minimum overlap length = 40 bp, minimum similarity percentage = 90% and probability limit error = 1%) were determinant to correctly build consensus over such pairs. Two of these pairs (PCCMN363 and PCCMN351) create the same problem of erroneously insertion of gaps as shown form SeqTrace (Fig. 4). Furthermore, 5 sequence pairs did not assemble as they did not overlap under either PIPEBAR nor Geneious. Two sequence pairs (PCUBC568-ITS, PCUBC799-ITS) reached the minimum overlap similarity criteria, but did not fulfill the minimum overlap length. The last 2 sequence pairs (VASCB012-ITS and VASCB062-ITS) reached the minimum overlap length criteria but they did not observed the minimum overlap similarity threshold.

Table 2 Overlap similarities and length of sequence pairs that were not assembled by PIPEBAR nor Geneious in the Dataset 1

The overall base quality of the final sequences obtained by both PIPEBAR and Geneious are available in the Additional file 1. As SeqTrace does not generate a FASTQ file, it was not possible to evaluate final sequence quality.

As we considered Geneious our benchmark, since it obtained the best results showed in Table 1, we also compared its results to PIPEBAR’s in all 3 datasets to see how close PIPEBAR’s results are from Geneious’, as Table 3 shows. The results indicate that PIPEBAR’s barcode sequences are almost identical to the sequences generated by Geneious toolbox, with the lowest identity percentage being 99.3% in Dataset 3.

Table 3 Analysis of PIPEBAR’s barcodes with respect to the mean similarity percentage of all the generated sequences to its respective Geneious’ sequences, mean length of the alignment, total sum of mismatches and gap openings by applying Blastn against the Geneious’ reference sequences

Additionally, we added a trusteeship step in order to facilitate the submission process of the barcode sequences to Genbank and to provide correct data for downstream analyses while handling with barcodes originated from coding regions. Stop codon and frameshifts are a problem during the sequences submission to NCBI. All sequences should be in the same frame and must not contain stop codons. Our algorithm is able to correct all the assembled sequences to the first frame in the 5′-3′ direction and trims the sequences at all the stop codons detected. Comparing to the others softwares described here, PIPEBAR is the only one providing such facility.

After stop codons trimming and frameshift corrections, the final barcode sequences can be submitted without further edition to databases such as BOLD and NCBI regarding the presence of stop codons. This is an additional step not present in the other tools that we have tested.

OverlapPER results

To evaluate the performance of OverlapPER we used simulated data to benchmark against FLASH, COPE, BBmerge and PEAR. In our tests, IeeHom did not generate any result, even with the default parameters given in the manual, PANDAseq requires that the reads have been sequenced in Illumina Sequencers and that even the header of the reads in the FASTQ file is in Illumina format, and Geneious required a high amount of RAM, besides being a commercial software. Thus, we chose to discard these tools from comparison with OverlapPER, allowing tools that do not limit the sequence technology used to generate the data and are open-source. All the synthetic data sets are available from the OverlapPER’s website.

We used ART [42] to simulate an Illumina MiSeq v3 (2x250bp) sequencing of 1,000,000 paired-end reads from fragments with a mean size of 400 bp and a standard deviation of 10 bp, using an NCBI reference genome (Escherichia coli str. K-12 substr. MG1655, NC_000913.3). The dataset generated with ART can be obtained at https://sourceforge.net/projects/overlapper-reads/files/Illumina_ART_simulation/.

Table 4 shows the results obtained by running OverlapPER, FLASH, COPE and PEAR in a six-core 1.9 GHz Intel Xeon computer with 32 GB of RAM, running Ubuntu 16.04 LTS. All tools (except COPE) were with the minimum overlap of 10 bp; All tools (except PEAR) had the minimum identity percentage of the overlapped region configured to 90%. For calculating the average run time and its standard deviation, we executed each tool three times.

Table 4 Results obtained by OverlapPER, PEAR, FLASH and COPE

In order to evaluate result correctness, we used BLAST+ [43] to align the merged sequences of each tool against the reference genome. OverlapPER performed best, by merging 99.97% of the paired-end reads with the highest mean similarity percentage (97.52%) and the lowest mean gap openings (2.62) (Table 4). OverlapPER presents a good tradeoff between sensitivity and scalability.

PEAR almost reached the same performance of OverlapPER when comparing the total merged pairs (4058 assembled sequences less than OverlapPER), mean length of merged sequences, mean percentage of identity (1.3% less than OverlapPER), and mean gap opening. Regarding run time, PEAR took 2.5 times longer (22.7 min) than OverlapPER (8.5 min).

With the results shown above, we felt secure about including OverlapPER in the PIPEBAR workflow.

Conclusion

PIPEBAR was devised to efficiently assist DNA barcode analysis of sequences generated by Sanger sequencing. The chromatogram trace files or pair of forward and reverse trace files are converted into a single high quality consensus sequence. The pipeline strategically wraps several open-source software, making it possible to run barcode analysis of hundreds of sequences in a fast, accurate and concise command line (shell script). Despite the many proprietary and free software available, only SeqTrace provides a complete free and open-source toolbox. However, it is, intrinsically, a stand-alone program and many sequence analysis tasks are manually assisted, demanding a high interaction with the user. SeqTrace generated a large number of mismatches and gaps in the final consensus sequences with damaging consequences for biodiversity assessment such as phylogenetic diversity analysis.

PIPEBAR is the only program producing similarly high quality consensus sequences as accurate as the widely used proprietary Geneious, but it is faster than any software available for barcoding data analysis. Furthermore, PIPEBAR can be used to facilitate the submission of barcode sequences to databases such as BOLD and NCBI.

OverlapPER was implemented to assemble a pair of forward and reverse sequences and obtained favorable results when compared to other similar tools and it is included in PIPEBAR workflow. We recommend the use of OverlapPER in bioinformatics pipelines when paired-end reads are used for genome sequencing or re-sequencing and for the production of DNA barcodes using Sanger sequencing.

Availability and requirements

Project name: PIPEBAR

Project home page: e.g. https://sourceforge.net/projects/PIPEBAR/

Operating system(s): Platform independent

Programming language: Python

Other requirements: Docker and Python 2.7+

License: GNU GPL

Any restrictions to use by non-academics: none

Project name: OverlapPER

Project home page: e.g. https://sourceforge.net/projects/overlapper-reads/

Operating system(s): Platform independent

Programming language: Python

Other requirements: Python 2.7+

License: GNU GPL

Any restrictions to use by non-academics: none

Abbreviations

BOLD:

Barcode of life database

CBOL:

Consortium for the barcode of life

COI:

Cytochrome c oxidase

CPU:

Central processing unit

DNA:

Desoxyribonucleic acid

LTS:

Long time support

NCBI:

National center for biotechnology information

NGS:

Next generation sequence

RAM:

Random access memory

References

  1. Xu C, Lang-Muritano M, Phan-Hug F, Dwyer AA, Sykiotis GP, Cassatella D, Acierno J Jr, Mohammadi M, Pitteloud N. Genetic testing facilitates prepubertal diagnosis of congenital hypogonadotropic hypogonadism. Clin Genet. 2017;92:213–6.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  2. Jiao L, Yu M, Wiedenhoeft AC, He T, Li J, Liu B, Jiang X, Yin Y. DNA barcode authentication and library development for the wood of six commercial Pterocarpus species: the critical role of Xylarium specimens. Sci Rep. 2018;8:1945.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  3. Hausmann A, Miller SE, Holloway JD, de Waard JR, Pollock D, Prosser SWJ, Hebert PDN. Calibrating the taxonomy of a megadiverse insect family: 3000 DNA barcodes from geometrid type specimens (Lepidoptera, Geometridae). Genome. 2016;59:671–84.

    Article  PubMed  CAS  Google Scholar 

  4. Costion C, Lowe A, Rossetto M, Kooyman R, Breed M, Ford A, Crayn D. Building a plant DNA barcode reference library for a diverse tropical Flora: an example from Queensland, Australia. Diversity. 2016;8:5.

    Article  Google Scholar 

  5. Babiychuk E, Kushnir S, Vasconcelos S, Dias MC, Carvalho-Filho N, Nunes GL, Dos Santos JF, Tyski L, da Silva DF, Castilho A, Fonseca VLI, Oliveira G. Natural history of the narrow endemics Ipomoea cavalcantei and I. Marabaensis from Amazon Canga savannahs. Sci Rep. 2017;7:7493.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  6. BARCODE OF LIFE on JSTOR [http://0-www-jstor-org.brum.beds.ac.uk/stable/26000849].

  7. Smith MA, Fisher BL, Hebert PDN. DNA barcoding for effective biodiversity assessment of a hyperdiverse arthropod group: the ants of Madagascar. Philos Trans R Soc Lond Ser B Biol Sci. 2005;360:1825–34.

    Article  CAS  Google Scholar 

  8. Hebert PDN, Cywinska A, Ball SL, de Waard JR. Biological identifications through DNA barcodes. Proc R Soc B Biol Sci. 2003;270:313–21.

    Article  CAS  Google Scholar 

  9. Desalle R. Species discovery versus species identification in DNA barcoding efforts: response to Rubinoff. Conserv Biol. 2006;20:1545–7.

    Article  PubMed  Google Scholar 

  10. Ratnasingham S, Hebert PDN. BARCODING: bold: the barcode of Life data system (http://www.barcodinglife.org). Mol Ecol Notes. 2007;7:355–64.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  11. Chase MW, Cowan RS, Hollingsworth PM, van den Berg C, Madriñán S, Petersen G, Seberg O, Jørgsensen T, Cameron KM, Carine M, Pedersen N, Hedderson TAJ, Conrad F, Salazar GA, Richardson JE, Hollingsworth ML, Barraclough TG, Kelly L, Wilkinson M. A proposal for a standardised protocol to barcode all land plants. Taxon. 2007;56(2):295–9.

    Google Scholar 

  12. A DNA barcode for land plants. - PubMed - NCBI [http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/19666622].

  13. Fazekas AJ, Burgess KS, Kesanakurti PR, Graham SW, Newmaster SG, Husband BC, Percy DM, Hajibabaei M, Barrett SCH. Multiple multilocus DNA barcodes from the plastid genome discriminate plant species equally well. PLoS One. 2008;3:e2802.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  14. Hollingsworth ML, Andra Clark A, Forrest LL, Richardson J, Pennington RT, Long DG, Cowan R, Chase MW, Gaudeul M, Hollingsworth PM. Selecting barcoding loci for plants: evaluation of seven candidate loci with species-level sampling in three divergent groups of land plants. Mol Ecol Resour. 2009;9:439–57.

    Article  PubMed  CAS  Google Scholar 

  15. Hollingsworth PM, Graham SW, Little DP. Choosing and using a plant DNA barcode. PLoS One. 2011;6:e19254.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  16. Chen S, Yao H, Han J, Liu C, Song J, Shi L, Zhu Y, Ma X, Gao T, Pang X, Luo K, Li Y, Li X, Jia X, Lin Y, Leon C. Validation of the ITS2 region as a novel DNA barcode for identifying medicinal plant species. PLoS One. 2010;5:e8613.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  17. Caetano Wyler S, Naciri Y. Evolutionary histories determine DNA barcoding success in vascular plants: seven case studies using intraspecific broad sampling of closely related species. BMC Evol Biol. 2016;16:103.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  18. Casiraghi M, Labra M, Ferri E, Galimberti A, De Mattia F. DNA barcoding: a six-question tour to improve users’ awareness about the method. Brief Bioinform. 2010;11:440–53.

    Article  PubMed  CAS  Google Scholar 

  19. 4Peaks: For peaks, four peaks. The DNA sequence trace viewer for OS X [https://nucleobytes.com/4peaks/index.html].

  20. Chromas | Technelysium Pty Ltd [http://technelysium.com.au/wp/chromas/].

  21. FinchTV [https://digitalworldbiology.com/FinchTV].

  22. Pal K, Bystry V, Reigl T, Demko M, Krejci A, Touloumenidou T, Stalika E, Tichy B, Ghia P, Stamatopoulos K, Pospisilova S, Malcikova J, Darzentas N. GLASS: assisted and standardized assessment of gene variations from sanger sequence trace data. Bioinformatics. 2017;33:3802–4.

    Article  PubMed  Google Scholar 

  23. CLC Genomics Workbench - QIAGEN Bioinformatics [https://www.qiagenbioinformatics.com/?qia-storyline=products/clc-genomics-workbench].

  24. BioEdit Sequence Alignment Editor for Windows 95/98/NT/XP [http://www.mbio.ncsu.edu/BioEdit/bioedit.html].

  25. Stucky BJ. SeqTrace: a graphical tool for rapidly processing DNA sequencing chromatograms. J Biomol Tech. 2012;23:90–3.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Sequencher DNA Sequence Analysis Software from Gene Codes Corporation [https://www.genecodes.com/].

  27. Brown SDJ, Collins RA, Boyer S, Lefort M-C, Malumbres-Olarte J, Vink CJ, Cruickshank RH. Spider: an R package for the analysis of species identity and evolution, with particular reference to DNA barcoding. Mol Ecol Resour. 2012;12:562–5.

    Article  PubMed  Google Scholar 

  28. Pandey RV, Pabinger S, Kriegner A, Weinhäusel A. ClinQC: a tool for quality control and cleaning of sanger and NGS data in clinical research. BMC Bioinformatics. 2016;17:56.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  29. Wheeler DL. Database resources of the National Center for biotechnology information. Nucleic Acids Res. 2004;33:D39–45.

    Article  PubMed Central  Google Scholar 

  30. Rice P, Longden I, Bleasby A. EMBOSS: the European molecular biology open software suite. Trends Genet. 2000;16:276–7.

    Article  PubMed  CAS  Google Scholar 

  31. Schmieder R, Edwards R. Quality control and preprocessing of metagenomic datasets. Bioinformatics. 2011;27:863–4.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  32. Bushnell B, Rood J, Singer E. BBMerge – accurate paired shotgun read merging via overlap. PLoS One. 2017;12:e0185056.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  33. Magoč T, Salzberg SL. FLASH: fast length adjustment of short reads to improve genome assemblies. Bioinformatics. 2011;27:2957–63.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  34. Renaud G, Stenzel U, Kelso J. leeHom: adaptor trimming and merging for Illumina sequencing reads. Nucleic Acids Res. 2014;42:e141.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  35. Liu B, Yuan J, Yiu S-M, Li Z, Xie Y, Chen Y, Shi Y, Zhang H, Li Y, Lam T-W, Luo R. COPE: an accurate k-mer-based pair-end reads connection tool to facilitate genome assembly. Bioinformatics. 2012;28:2870–4.

    Article  PubMed  CAS  Google Scholar 

  36. Zhang J, Kobert K, Flouri T, Stamatakis A. PEAR: a fast and accurate Illumina paired-end reAd mergeR. Bioinformatics. 2014;30:614–20.

    Article  PubMed  CAS  Google Scholar 

  37. Masella AP, Bartram AK, Truszkowski JM, Brown DG, Neufeld JD. PANDAseq: paired-end assembler for illumina sequences. BMC Bioinformatics. 2012;13:31.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  38. Churchill GA, Waterman MS. The accuracy of DNA sequences: estimating sequence quality. Genomics. 1992;14:89–98.

    Article  PubMed  CAS  Google Scholar 

  39. Lawrence CB, Solovyev VV. Assignment of position-specific error probability to primary DNA sequence data. Nucleic Acids Res. 1994;22:1272–80.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  40. Bonfield JK, Staden R. The application of numerical estimates of base calling accuracy to DNA sequencing projects. Nucleic Acids Res. 1995;23:1406–10.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  41. Guralnick R, Hill A. Biodiversity informatics: automated approaches for documenting global biodiversity patterns and processes. Bioinformatics. 2009;25:421–8.

    Article  PubMed  CAS  Google Scholar 

  42. Huang W, Li L, Myers JR, Marth GT. ART: a next-generation sequencing read simulator. Bioinformatics. 2012;28:593–4.

    Article  PubMed  CAS  Google Scholar 

  43. Camacho C, Coulouris G, Avagyan V, Ma N, Papadopoulos J, Bealer K, Madden TL. BLAST+: architecture and applications. BMC Bioinformatics. 2009;10:421.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  44. Tatusova TA, Madden TL. BLAST 2 sequences, a new tool for comparing protein and nucleotide sequences. FEMS Microbiol Lett. 1999;174:247–50.

    Article  PubMed  CAS  Google Scholar 

  45. Katoh K, Misawa K, Kuma K-I, Miyata T. MAFFT: a novel method for rapid multiple sequence alignment based on fast Fourier transform. Nucleic Acids Res. 2002;30:3059–66.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

Download references

Acknowledgements

We would like to thank the Instituto Tecnológico Vale (ITV) for providing all the necessary equipment to perform the research presented in this work.

Funding

This work was supported by Vale (TrogloGen and Canga Plant Genomics) to GO. RRMO (443270/2015–5), GLN (440880/2013–0) and GO (307479/2016–1) are fellows of the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq). RA (20/2016) is fellow of the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES). The funders had no role in the study design, data collection and interpretation, or the decision to submit the work for publication.

Availability of data and materials

The datasets generated and analyzed during the current study are available in the following sourceforge.net repositories: https://sourceforge.net/projects/PIPEBAR/ and https://sourceforge.net/projects/overlapper-reads/.

Author information

Authors and Affiliations

Authors

Contributions

RRMO implemented OverlapPER, performed the tests for both PIPEBAR and OverlapPER, as well as analyzing their results and was a major contributor in writing the manuscript. GLN contributed with writing some parts of the manuscript as well as downloading the used datasets, revision of the manuscript and with some ideas for improving the work. TGLL contributed with the creation of the Docker environment for using PIPEBAR as well as creating the scripts for the quality reports and the stop-codon and frameshift correction. GCO contributed with ideas for improving the work and revision of the manuscript. RA idealized and implemented PIPEBAR, contributed with ideas for improving the pipeline, as well as with the revision of the manuscript. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Renato Renison Moreira Oliveira or Ronnie Alves.

Ethics declarations

Ethics approval and consent to participate

Not applicable

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

PIPEBAR and OverlapPER’s usage. Here we show all the instructions for the installation of Pipebar and all the commands used in the tests made with Pipebar, OverlapPER and the other tools used as benchmark. (PDF 639 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Oliveira, R.R.M., Nunes, G.L., de Lima, T.G.L. et al. PIPEBAR and OverlapPER: tools for a fast and accurate DNA barcoding analysis and paired-end assembly. BMC Bioinformatics 19, 297 (2018). https://0-doi-org.brum.beds.ac.uk/10.1186/s12859-018-2307-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12859-018-2307-y

Keywords