News for hackers. Stuff that matters.
Re:How much is Spotify paying Google Cloud? by patrickmclaren on Monday March 07, 2016 @07:57PM (#11242887)
Note by "queuing and batching" Spotify may be aggregating events client-side. Given that messages are priced in 64K increments, it would be most cost efficient to to get each message as close to 64K as possible.

i.e.

  # serialized: 1 message, 1 op
  publish("['foo', 'bar']")
  
  # instead of:
  
  # a) 2 messages, 2 ops
  publish("foo")
  publish("bar")
  
  # b) 2 messages, 1 call, 2 ops
  publish("foo", "bar")
Re:How much is Spotify paying Google Cloud? by dmytton on Tuesday March 08, 2016 @02:02AM (#11243911)
Yes then it would be down to their consumers to split them out. However, the graphs Spotify show from Google's monitoring do not support this and they show the actual volume of messages as quoted in the article.
Re:How much is Spotify paying Google Cloud? by patrickmclaren on Tuesday March 08, 2016 @11:28AM (#11246261)
I agree that the current graphs from Spotify don't support this. They do seem to show a one-to-one mapping between events and messages emitted. Given the comparison in my GP, I think that client-side message collation/aggregation would be a natural next step.