I really can't tell but it seems to be a continuation of this work if I read the...

jonbaer on Feb 28, 2024 | parent | context | favorite | on: The Era of 1-bit LLMs: ternary parameters for cost...

I really can't tell but it seems to be a continuation of this work if I read the To-Dos correctly, what do you think? Here it seems to be 1-bit on just the transformer, https://huggingface.co/shi3z/BitNetWikipedia110M