does mlc work for vision models? for example, the doc mentions --max-seq-len MAX... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

billconan on Aug 15, 2023 | parent | context | favorite | on: GPU-Accelerated LLM on an Orange Pi

does mlc work for vision models? for example, the doc mentions --max-seq-len MAX_ALLOWED_SEQUENCE_LENGTH as a command line option. This seems to imply that it only accepts language models?

Also, it doesn't seem to say anything about the input model's format? pytorch weights? onnx?

gsuuon on Aug 16, 2023 [–]

Yup, here's their web stable diffusion repo: https://github.com/mlc-ai/web-stable-diffusion

The input is a model (weights + runtime lib) compiled via the mlc-llm project: https://mlc.ai/mlc-llm/docs/compilation/compile_models.html

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact