Strictly define how JSONs are separated in GRPC gateway
I use GRPC gateway to access etcd watching functionality. Namely, https://github.com/etcd-io/etcd/blob/master/Documentation/dev-guide/api_grpc_gateway.md#watch-keys .
But I don't have any specifications on how should I separate JSONs in the response stream since it is not documented anywhere.
Basically I have 3 ways:
HTTP chunk = message This fails at least in Fedora 31 on high load because sometimes bare newline
\nappears as a separate chunk. In order to fix you probably should first concatenate JSON with\nbefore calling toWrite(). Also, intermediate proxies may re-chunk stream.Messages are separated using strictly one newline. It is not documented as well, and comment in GRPC gateway states that newline is added just to simplify debugging. Somewhere in the net, I found that other software uses a double newline for that purpose (allow to divide messages containing formatted JSON). Currently, I choose this way.
Use JSON finite state machine to detect end of a message. This way will work in any case, but technically this requires additional libraries for the majority of programming languages.
So, Please strictly document exact behavior (protocol) which should be considered for implementing JSON stream parser.
Original issue: https://github.com/grpc-ecosystem/grpc-gateway/issues/1086
Source: etcd-io/etcd