Evaluating Performance of In-Browser Data Processing Libraries

Objective

The primary objective is to develop a comprehensive framework that allows for the comparison and evaluation of various In-Browser backends, enabling experts to make informed decisions when selecting the most suitable backend for interactive data exploration in web applications

Problem Statement

Interactive exploration presents a multitude of challenges, notably the lack of user engagement due to slow responsiveness and the necessity of complex backend operations to facilitate efficient and effective interactions. Visual experts tackle these challenges by leveraging different libraries, such as Arquero and Duckdb-wasm, depending on the specific use cases at hand. However, there is a pressing need to provide experts with guidance on selecting the most suitable In-Browser backend for their interactive exploration tasks.

Deliverables

• A framework capable of evaluating the efficiency and effectiveness of In-Browser data processing libraries
• Local MongoDB client that allows users to establish a direct connection to MongoDB from Observable, leveraging Node as an intermediary service. Github | Demo
• Framework can easily adaptable to new data processing libraries, ensuring flexibility and compatibility with evolving technologies.