Skip to main content

Table 8 Partitioned build time and query speed for AFS31RS90 database

From: A big data approach to metagenomics for all-food-sequencing

Tool

Build time

Max. Memory

Query Speed

Max. Memory

AFS-MetaCache (1 part.)

3h 10min

135 GB

7.2 MR/m

117 GB

AFS-MetaCache (2 part.)

3h 04min

82 GB

3.1 MR/m

70 GB

AFS-MetaCache (4 part.)

3h 45min

52 GB

2.5 MR/m

39 GB

MetaCacheSpark (8Ex-32Th)

2h 57min

175 GB

4.3 MR/m

76 GB

MetaCacheSpark (16Ex-16Th)

1h 57min

100 GB

3.4 MR/m

48 GB

MetaCacheSpark (32Ex-8Th)

1h 25min

69 GB

2.2 MR/m

37 GB

MetaCacheSpark (64Ex-4Th)

1h 03min

45 GB

1.4 MR/m

29 GB

  1. Query speed measured for dataset KAL_D in million reads per minute (MR/m). For MetaCacheSpark, the number of executors and threads per executor are indicated