# About the Course category **URL:** \ **Category:** Course\ **Created:** [June 11, 2021, 2:26pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728 "2021-06-11T14:26:00Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![sgugger](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sgugger/32/2291_2.png) [@sgugger](https://discuss.huggingface.co/u/sgugger)\ **Post date:** [June 11, 2021, 2:26pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/1 "2021-06-11T14:26:00Z")
Use this category to ask any question related to the [course](https://huggingface.co/course/) or organize study groups. ---
**Author:** ![akshay7](https://avatars.discourse-cdn.com/v4/letter/a/5daacb/32.png) [@akshay7](https://discuss.huggingface.co/u/akshay7)\ **Post date:** [June 14, 2021, 6:16pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/2 "2021-06-14T18:16:46Z")
Hey everyone, can we form a study group similar to how [MLT](https://twitter.com/ __MLT__ ) does it? I really suck at keeping up with a course alone and would love to set up a weekly meeting kind of thing where we all can actually go through some parts of the course on our own and then discuss the same. We can then leave the entire week to practice it out and then discuss it briefly at the start of the next week session before repeating. ---
**Author:** ![vinaykudari](https://avatars.discourse-cdn.com/v4/letter/v/d78d45/32.png) [@vinaykudari](https://discuss.huggingface.co/u/vinaykudari)\ **Post date:** [June 14, 2021, 7:46pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/3 "2021-06-14T19:46:34Z")
Sure, I’m up for it. Shall we setup a discord server? ---
**Author:** ![akshay7](https://avatars.discourse-cdn.com/v4/letter/a/5daacb/32.png) [@akshay7](https://discuss.huggingface.co/u/akshay7)\ **Post date:** [June 14, 2021, 8:35pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/4 "2021-06-14T20:35:04Z")
Yes Vinay, that’s the best way, I just set one up. Here’s a link to it: [https://discord.gg/AEz4reDd](https://discord.gg/AEz4reDd) .We can decide the days and time based on the people who join ---
**Author:** ![rizalespe](https://avatars.discourse-cdn.com/v4/letter/r/dc4da7/32.png) [@rizalespe](https://discuss.huggingface.co/u/rizalespe)\ **Post date:** [June 15, 2021, 5:56am UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/5 "2021-06-15T05:56:25Z")
Thanks, I already joined. ---
**Author:** ![Sanyam](https://avatars.discourse-cdn.com/v4/letter/s/e47774/32.png) [@Sanyam](https://discuss.huggingface.co/u/Sanyam)\ **Post date:** [June 15, 2021, 5:59am UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/6 "2021-06-15T05:59:03Z")
I’ve requested the kind people at MLT to help as well. Once we find enough interest-we’ll setup the meet-ups 😃 ---
**Author:** ![kiranmusze](https://avatars.discourse-cdn.com/v4/letter/k/e9a140/32.png) [@kiranmusze](https://discuss.huggingface.co/u/kiranmusze)\ **Post date:** [June 21, 2021, 7:14am UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/7 "2021-06-21T07:14:53Z")
First of all: many many thanks for putting this course online, it is a big help for me! I already worked through everything and now I can’t wait for the next part. When do you plan to put online chapters 5 - 8? Thank you very much! Kiran ---
**Author:** ![lewtun](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lewtun/32/30995_2.png) [@lewtun](https://discuss.huggingface.co/u/lewtun)\ **Post date:** [June 21, 2021, 1:51pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/8 "2021-06-21T13:51:17Z")
hey @kiranmusze - great to hear that you enjoyed the first part and congrats on finishing it so quickly! we plan to release the next part later this year, hopefully around autumn 🙂 ---
**Author:** ![anjalichadha](https://avatars.discourse-cdn.com/v4/letter/a/8edcca/32.png) [@anjalichadha](https://discuss.huggingface.co/u/anjalichadha)\ **Post date:** [July 7, 2021, 7:06am UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/9 "2021-07-07T07:06:03Z")
I am unable to join the discord server. It seems like the link has expired. Could you resend the invitation link? I am interested in joining the study group. Thanks! ---
**Author:** ![Givan](https://avatars.discourse-cdn.com/v4/letter/g/3ab097/32.png) [@Givan](https://discuss.huggingface.co/u/Givan)\ **Post date:** [July 18, 2021, 3:11am UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/10 "2021-07-18T03:11:43Z")
Where can I get slides of video? Thanks! ---
**Author:** ![lewtun](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lewtun/32/30995_2.png) [@lewtun](https://discuss.huggingface.co/u/lewtun)\ **Post date:** [July 19, 2021, 8:28pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/11 "2021-07-19T20:28:05Z")
hey @Givan we don’t plan to release the slides of the videos but almost everything is already reproduced in the course material / notebooks! ---
**Author:** ![Jovan](https://avatars.discourse-cdn.com/v4/letter/j/0ea827/32.png) [@Jovan](https://discuss.huggingface.co/u/Jovan)\ **Post date:** [August 30, 2021, 10:36am UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/12 "2021-08-30T10:36:04Z")
Hi Huggingface, First of all, thank you for the excellent course! I just wanted to check if there are any new updates regarding the expected next chapters? I am really looking forward to it! Best regards, Jovan ---
**Author:** ![SosigCatto](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sosigcatto/32/2611_2.png) [@SosigCatto](https://discuss.huggingface.co/u/SosigCatto)\ **Post date:** [August 31, 2021, 9:48am UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/13 "2021-08-31T09:48:17Z")
Just want to give a shoutout: many thanks and lots of love for putting this course online, it is a big help to understand the library and use it effectively. Hopefully chapters 5 - 8 will come out soon! Thank you very much again! Sosig ---
**Author:** ![lewtun](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lewtun/32/30995_2.png) [@lewtun](https://discuss.huggingface.co/u/lewtun)\ **Post date:** [September 2, 2021, 1:08pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/14 "2021-09-02T13:08:17Z")
Hey @Jovan we’re working on the next chapters right now and are aiming for a release sometime before the end of the year 🙂 ---
**Author:** ![Jovan](https://avatars.discourse-cdn.com/v4/letter/j/0ea827/32.png) [@Jovan](https://discuss.huggingface.co/u/Jovan)\ **Post date:** [September 13, 2021, 9:04am UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/15 "2021-09-13T09:04:17Z")
Hey @lewtun, Excellent, thanks for the reply, and special thanks for your efforts! ---
**Author:** ![Monsia](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/monsia/32/31680_2.png) [@Monsia](https://discuss.huggingface.co/u/Monsia)\ **Post date:** [September 27, 2021, 4:09pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/16 "2021-09-27T16:09:57Z")
I am looking for a learning path to become a huggingface 🤗 developer. From zero to hero 😁taking into account best practices. Does something like this exist? Thank you. 🙏 @sgugger @patrickvonplaten @lysandre ---
**Author:** ![mdroth](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mdroth/32/29308_2.png) [@mdroth](https://discuss.huggingface.co/u/mdroth)\ **Post date:** [June 5, 2023, 11:39pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/17 "2023-06-05T23:39:28Z")
**Please do cover [PEFT](https://huggingface.co/blog/peft)** and related stuff like [bitsandbytes](https://huggingface.co/blog/4bit-transformers-bitsandbytes) and combining **multiple adapters** in detail within one of the upcoming course sections! The sooner the better. I’m sure I am not the only one who really needs this. PEFT is _ **the** _ unlock for finetuning SOTA models (LLaMA, Falcon, and what is yet to come) on consumer graphics cards. @philschmid, @sgugger ---
**Author:** ![Kamboj112](https://avatars.discourse-cdn.com/v4/letter/k/4da419/32.png) [@Kamboj112](https://discuss.huggingface.co/u/Kamboj112)\ **Post date:** [December 1, 2023, 10:35am UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/19 "2023-12-01T10:35:01Z")
Hey! I am not able understand somethings . i was trying to make a chatbot which can generate reply from my custom dataset, first i trained gpt2 on my custom dataset for text generation and then i tried to finetune that on squad 2 dataset to make it work as question answering chatbot. Please help me with the approach whether i should continue down this path or any other suggestion will be good. ---
**Author:** ![r935249](https://avatars.discourse-cdn.com/v4/letter/r/a87d85/32.png) [@r935249](https://discuss.huggingface.co/u/r935249)\ **Post date:** [March 28, 2024, 1:44pm UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/20 "2024-03-28T13:44:12Z")
Hi, I am checking the hugging face course. Its a very nice course to see how to adopt your pretrained models like BERT and GPT2/3 to develop your projects. As much as I am thankful for everyone at Hugging Face for taking this initiative so seriously, I am a little disappointed in how the material has been presented. Its like you read chap1, chap2, chap3, chap 4. chap 5 and then in chap 7 we will do integration of everything we have read so far. However, organization from the perspective of a reader should just be the opposite of this: We ought to be having chapter7 as chapter 1 or chapter 0. Like you can solve a problem bottom up manner but when presenting the solution you ought to follow Top down order i.e., you have to present how to use Bert and GPT3 or other LLMs in your project. First you want to cut it Bert NN before Logits and then you want to put a new header to it. And, then you want to do transfer learning with your own data for the problem you have. Like a tree traversal from the root node (starting point). I am sorry that I have blabbered that much but without seeing the big picture first seeing all those details after details in a huge essay like manner kind of causes understanding issues. Reasoning should be presented first up for everything no matter what level you are in the tree. ---
**Author:** ![yanchunwang](https://avatars.discourse-cdn.com/v4/letter/y/f0a364/32.png) [@yanchunwang](https://discuss.huggingface.co/u/yanchunwang)\ **Post date:** [February 27, 2025, 7:13am UTC](https://discuss.huggingface.co/t/about-the-course-category/6728/22 "2025-02-27T07:13:03Z")
“WordPiece tokenization” of chapter 6 , i calculate diff vocabulary with course : ```auto # the course's result Vocabulary: ["b", "h", "p", "##g", "##n", "##s", "##u", "##gs", "hu"] Corpus: ("hu" "##g", 10), ("p" "##u" "##g", 5), ("p" "##u" "##n", 12), ("b" "##u" "##n", 4), ("hu" "##gs", 5) # Then the next best score is shared by ("hu", "##g") and ("hu", "##gs") (with 1/15, compared to 1/21 for all the other pairs), so the first pair with the biggest score is merged: Vocabulary: ["b", "h", "p", "##g", "##n", "##s", "##u", "##gs", "hu", "hug"] Corpus: ("hug", 10), ("p" "##u" "##g", 5), ("p" "##u" "##n", 12), ("b" "##u" "##n", 4), ("hu" "##gs", 5) ``` ```auto # my calculate result vocabulary = ["b", "h", "p", "##g", "##n", "##s", "##u","##gs","hu"] corpus = ("hu" "##g", 10), ("p" "##u" "##g", 5), ("p" "##u" "##n", 12), ("b" "##u" "##n", 4), ("hu" "##gs", 5) hug 10 hug (10)/((10 + 5) * (10 + 5)) = 10 / 225 = 0.0444 pu 5 pu (5 + 12)/((5 + 12) * (5 + 12 + 4)) = 17 / (17 * 21) = 0.0476 ##ug 5 ##ug (5)/((5 + 12 + 4) * (10 + 5)) = 5 / 315 = 0.0158 pu 12 ##un (12 + 4)/((5 + 12 + 4) * (12 + 4)) = 17 / 336 = 0.0505 ##un 12 bu (4)/((4) * (5 + 12 + 4)) = 4 / 84 = 0.0476 bu 4 hugs (5)/((10 + 5) * (5)) = 5 / 75 = 0.0666 ##un 4 hugs 5 vocabulary = ["b", "h", "p", "##g", "##n", "##s", "##u","##gs","hu","hugs"] corpus = ("hu" "##g", 10), ("p" "##u" "##g", 5), ("p" "##u" "##n", 12), ("b" "##u" "##n", 4) ``` someone can tell me why? i can’t understand. [Next page](https://discuss.huggingface.co/t/about-the-course-category/6728.md?page=2)