Research
Talking Heads
https://arxivxplorer.com/?query=realtime+talking+heads+code
- https://paperswithcode.com/paper/write-a-speaker-text-based-emotional-and
LMQL-like
These techs interact with LLM at a granular token-by-token level and have ability to format the LLM response
https://lmql.ai/ (they have a Discord)
https://github.com/microsoft/guidance (they don't)
LLM SotA
- https://github.com/bigcode-project/starcoder LLM trained for coding
Who are the big players:
- OpenAI (ClosedAI, good luck waiting for your GPT4 key)
- Google: PaLM
- Cohere (are they behind the leaders?)
- Anthropic https://www.anthropic.com/index/100k-context-windows (I'm waiting for an API key)
- Anyone else?
Misc
- ToolFormer (Language Models Can Teach Themselves to Use Tools)
- https://arxiv.org/abs/2302.04761
- https://github.com/lucidrains/toolformer-pytorch
- Tree of Thoughts: https://arxiv.org/abs/2305.10601
- covered by Yannic(https://www.youtube.com/watch?v=ut5kp56wW_4&t=3s&ab_channel=YannicKilcher) and WesRoth (https://www.youtube.com/watch?v=BrjAt-wvEXI&ab_channel=WesRoth)
- https://github.com/ysymyth/tree-of-thought-llm