US and EU stock indices data ingestion currently broken

An update on data ingestion and chart generation Here is a real quick update on what can currently be observed on the main website: Our main data source for US and EU stock indices changed some internals, which is why the automated data ingestion no longer works. Hence, the automatically generated charts stopped updating in June. Unfortunately we noticed very late, and now the charts for the US and EU stock indices are outdated. The charts for indices from India and all crypto-related things are not affected. What are the next steps to fix the US and EU stock indices charts? We are going to look for another data source and adapt all things accordingly. We will let you know as soon as everything is fixed.    

Milestone complete - automated charting for all indices done

Milestone reached!

That was fast! After a couple of hours, the automated charting for all indices, including their prices and their market breadth indicators, is complete.

My updated tool stack will now produce an interactive chart dashboard per index on demand. Zooming, scrolling etc. is possible. All charts within one dashboard share the same x axis (date).

 

And the best: In contrast to the existing data dashboard, the new charting stuff does not require a (time-series) database, thus giving me a smaller footprint regarding cpu and memory.


So, what are the next steps?

Next, I want to add an automated image export for all index chart dashboards.

Those images shall be produced daily and be uploaded to a very simple website presenting those images. This would provide everyone with the possibility to view market breadth data for every index I have in my collection, including crypto indicies.

In the (not so) distant future, I want to add even more crypto indices.

Maybe I might also add ETF data in the (this time for real) very distant future.


I will start to think about how I can create this simple website. I will then have to think about renting another VPS for it so I have separation for data handling and data presentation.


Comments

Popular posts from this blog

US and EU stock indices data ingestion currently broken

Crypto Market Barometer released on advance-decline.net

State of Dow Jones - Calendar Week 42 2021