Mathematica and the (10^10)-Row Database

Using Dynamic Interactivity to Build Rich Dashboard Interfaces to Very Big Data

Adam Jacobs

1010data, Inc.

Abstract

1010data, Inc.'s analytical database, Tenbase, is used widely in financial, retail, medical, and other environments to perform sophisticated analyses on very large datasets—routinely involving individual tables with billions to tens of billions of rows, with hundred billion- and even trillion-row tables on the horizon and approaching rapidly. Tenbase is "software as a service," delivered over the Internet with a web-based interface or an XML API, and 1010data has thus far concentrated more on raw speed and analytical flexibility than on a rich visualization layer. This is changing.

Mathematica, with its unparalleled data manipulation and visualization abilities, is an excellent complement to Tenbase, and our MathLink-based interface library brings access to the raw data-crunching power and the billions of rows of data right into the Mathematica session for ad-hoc analysis. The introduction of the rich dynamic interactivity language in Mathematica Version 6.0 and especially 7.0, however, is making it possible for us to go even further.  I will discuss and demonstrate how we are using Mathematica and Mathematica Player Pro as a platform for  delivering interactive dashboard and data visualization applications to our customers.