WingNews logo WingNews
top | item 28635526

(no title)

brinox | 4 years ago

You can configure the message size limit on your gRPC server, doesn't that fix your issue?

discuss

order

CommonGuy|4 years ago

Another option could be to "chunk" the messages with client-/server-streaming or bi-directional calls. But if you call your API from a browser, that may not be possible yet

sjnair96|4 years ago

Yes, but that would involve us digging into the code of the gRPC server, which is unfortunately closed to us :(

sjnair96|4 years ago

Ahh, we don't have access to the server. It's closed - an NVIDIA inference engine. Which under the hood talks to their Triton engine. Unfortunately, while Triton allows configuring the limit, the layer in front of it eats our channel options which have the message size configurations.