Dealing with large number of data points
Data tables with a large number of rows pose three problems:
- They can exceed upload file size limits. There is a limit in the app but there may also be one in the web browser used and on the server hosting the app.
- The app performance gets degraded. Although this is partly dependent on the set up (i.e. hardware, network), it's acceptable with 15000 rows and still usable but noticeably slower with 100000.
- Points pile up on top of each other in the plot. This obscures use of different colours and makes selecting a particular point impossible. Zooming in only partially alleviates the issue because it only works when there aren't too many points in the zoomed in area.