I like the use of the functional API here. I learned through a similar route and it was very helpful for me compared to trying to understand `torch.nn.Module`.
Yes, these are two different learning paths. The detailed process learning is beneficial for future research, while the API-style approach is convenient and quick for getting started and using. Both are very useful!
It's more than just that, practically every notable open model released in the past year or so uses tiktoken as the tokenizer.
therealoliver 22 hours ago [-]
I'm glad to have helped you :)
6 hours ago [-]
aghilmort 1 days ago [-]
great need; mulling over; shows up all the time in AI paradigms
therealoliver 22 hours ago [-]
glad to have helped you :)
aghilmort 2 hours ago [-]
just realized Siri typo'd meant to say great read
FreebasingLLMs 1 days ago [-]
[flagged]
jawr 1 days ago [-]
If you’ve got nothing constructive to say… don’t say anything? OP brings a lot of value in a style they like, your comment brings absolutely nothing.
therealoliver 22 hours ago [-]
Thank you for helping me out. Such comments are really depressing.
GaggiX 9 hours ago [-]
Ignore the troll that cries over Anya.
FreebasingLLMs 9 hours ago [-]
Real life feedback: drop the anime shit. It is way out of place. I'm not kidding.
FreebasingLLMs 9 hours ago [-]
I said what I said with purpose. I can't share this shit with anyone serious. It looks like someone who watches too much cartoon porn made this. I'm sorry these types of real life viewpoints offend you. I do sincerely suggest you reflect on what I am saying and consider it with weight.
therealoliver 7 hours ago [-]
Thanks for ur feedback on the project's visual style. Let me clarify a few things: First, associating an anime character, especially a minor, with inappropriate content is unfair and disrespectful to both the character and the original work. Second, this character wasn’t added by me—it was included by the previous developer who created these visualizations. As part of the open-source community, I believe it’s important to respect the project’s history and acknowledge their contributions. Lastly, I appreciate your perspective—it might highlight how cultural differences can shape perceptions, and I’ll pay attention to that in my subsequent work. That said, I also value maintaining the entertainment and avoiding overly dry or preachy content, which I think is equally important. This will likely be my final reply on this matter. Let’s focus on being open-minded and keeping the community peaceful. Thanks again for your support of the technical aspects of the project
Here's a gist of my learning path if it's helpful to anyone: https://gist.github.com/kevmo314/294001659324429bae6749062a9...