🏠 back to Observable

How to accumulate data everyday

Dear Master,

What i want is to do everyday web scrapping, takes some data from any sites and accumulate that data into a cell for example into array. However the problem is the cell have run button, so if i click it accidentally, all data accumulated on that cell will be wiped out and the array will be empty back.

Can anyone help me how to preparring cell or variable with initial value that will never reseting its value at anytime.

Thanks before

Can you include a link to a notebook with the described behavior ?

Please refer to https://observablehq.com/@binarmaya/example-of-promises-tick-and-mutable-variabel

SomeArr always reset its value when i re-open the url…
What i want is SomeArr keep continue accumulating its content even when i leave its web page?

Is there any solution?

Observable is not the right tool for this. You’ll have to use an external service or setup your own server process to accumulate the data, e.g. via glitch.com.

You can then use an external cron service to regularly “awaken” your glitch instance and have it fetch the data.

More details on persisting data with glitch.com can be found here: https://glitch.com/help/db/

2 Likes

Thanks…

I will take a look at glitch.com

Get BlueMail for Android

For another approach, see this tutorial on using AWS:

1 Like

Will persisting data to local storage help you? This notebook shows how we can add data to local storage for a cell. Note: You have to sync the localstorage and cell value though.

1 Like