2/18/2024 0 Comments Chatbot discord bot![]() ![]() Enable other key features (more on this below).People find familiar (see the success of ChatGPT). ![]() How to make this work in a chatbot settingĪs mentioned before, we believe a chatbot setting is an important UX decision that: While it may be easy to take a generic ingestion tool and use that as a way to get quickly started, doing deeper inspection and modifying your pipeline will probably be necessary to get better performance. We fixed this by changing the parser to explicitly ignore those areas.Īlthough specific to this layout, we do believe this highlights the importance of being very intentional about what data you do (or do not) include as potential context. When we inspected some of the bad results we were getting, we saw that often it was these pieces of information that were getting pulled and stuffed into the context. As a visual example, in the picture below the two areas in red don’t really provide much new information.Ī screenshot of the problematic sidebar contents. However, after using these results we found that some of the sidebar contents were creating bad results. For this we initially did this in a generic way (just using Beautiful Soup to get all the text on the page). For that reason we decided to go with scraping it from the internet.Īfter that, we faced a question of how to preprocess the html files. While some of the files in GitHub were in a nice format to work with (markdown and rst) we also had some less good for working with (.ipynb files, auto generated docs). There were two options: the files in GitHub, or scraping from the internet. We immediately faced a question: where exactly to get the data from.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |