TorchScript server
Author: lutzroederCreated Oct 9, 2022Updated Mar 1, 2025
Labelsfeature
Prototype exploring to use the Python Server to load and serve TorchScript models.
Example:
import torch
import torchvision
import netron
model = torchvision.models.resnet34()
model = torch.jit.script(model)
traced_model = torch.jit.trace(model, torch.zeros([1, 3, 224, 224]), strict=True)
torch._C._jit_pass_inline(traced_model.graph)
netron.serve('resnet34', traced_model)Source: lutzroeder/netron