Treasure Data's primary idea portal. 

Submit your ideas & feature requests directly to our product requirements team! We look forward to hearing from you.

Use GPU's for sorting

A recent Arxiv article (posted to Hacker News) suggests that there can be significant gains in sorting performance by leveraging GPU's:  

We know that one of Treasure Data's infrastructure weaknesses is when we include "order by" in the queries.  Sorting is not something that lends itself easily to distribution across the cluster, so it tends to run in a single node.  Perhaps if Presto were updated to leverage a GPU sort, we could have a GPU node in our cluster that would be optimized for implementing order by.

  • Rick Otten
  • Sep 11 2017