Gigabytes of data for a bag of groceries. That’s what you get when you do robotic delivery.That’s a lot of data – especially if you repeat it over a million times Just like us.

But the rabbit hole goes deeper. The data is also very diverse: robot sensor and image data, user interactions with our app, transaction data from orders, and more. Equally diverse are the use cases, from training deep neural networks to creating beautiful visualizations for our business partners, and everything in between.

So far, we’ve been able to handle all of this complexity with our centralized data team. Continued exponential growth so far has us looking for new ways of working to keep pace.

We found that the data grid paradigm was the best way forward. I’ll describe Starship’s take on data grids below, but first, let’s briefly summarize the approach and why we decided to go with it.

What is a data grid?

The data grid framework is First describe Zhamak Dehghani.The paradigm is based on the following Core idea: Data products, data domains, data platforms, data governance.



Source link