User talk:Ottomata/Event Data Platform

Rendered with Parsoid
From Wikitech
(Redirected from User talk:Ottomata/Stream Data Platform)
Latest comment: 6 years ago by Awight in topic Considerations

Considerations

Love the proposal!

Some things that came up when we were looking into this architecture for JADE:

  • Consumers need to agree to honor suppression events, and scrub the data from their local replica.
  • We need some guidelines about how to keep a state database and an event log in sync. If the state database is needed in order to complete API requests that create events, we have a cycle that seemingly can only be resolved by relaxing some of our requirements, e.g. not giving a 100% guarantee that the API request was valid before returning a response.
  • Autoincrement IDs would need to come from some source other than the event log, which may introduce the above issue.

Awight (talk) 21:19, 30 October 2017 (UTC)Reply