Hardware Acceleration

Dask

Dask is the de facto parallel computing library for Python. Dask is gaining popularity over PySpark because of its relatively low overhead to set up.

This Dash app uses Dask and Datashader to explore 40 million rows of data in real-time.

Datashader

Datashader is an open-source Python library for server-side rendering of big data visualizations.

Dash apps integrate closely with Datashader to visualize big data. When zoomed out, Dash uses Datashader to render the entire “big data” visualization server-side. When zoomed in, Dash switches to Plotly graphing for interactive, high resolution data exploration.

Dash + Datashader can be scaled to 100s of millions of points with Dask and RAPIDS — see the Dask and RAPIDS demos for examples. 

This Dash app uses Datashader to visualize 1 million time series points in 300 lines of Python.

Read the Plotly + Datashader tutorial

HPC Dash apps need to run scheduled or long-running jobs. Here are a few examples of Python tasks that easily tie into the Dash Enterprise Job Queue:

• Polling a remote API every 5 minutes
• Sending an email report every night at midnight
• Retraining a long-running ML model based on user input

The cron tool is commonly used for this use case, but it is ill-suited for data scientists and horizontally scalable systems like Dash Enterprise. A more powerful, flexible solution is a job scheduler like the Dash Enterprise Job Queue.

Learn more about the Dash Enterprise Job Queue