{"id":1317,"date":"2020-12-22T04:26:07","date_gmt":"2020-12-21T21:26:07","guid":{"rendered":"http:\/\/www.miai.vn\/?p=1317"},"modified":"2020-12-22T04:26:07","modified_gmt":"2020-12-21T21:26:07","slug":"bert-series-chuong-2-nghich-mot-chut-voi-hugging-face","status":"publish","type":"post","link":"https:\/\/miai.vn\/?p=1317","title":{"rendered":"[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face"},"content":{"rendered":"\n<p>Ch\u00e0o c\u00e1c anh em, h\u00f4m nay ch\u00fang ta s\u1ebd c\u00f9ng t\u00ecm hi\u1ec3u v\u1ec1 th\u01b0 vi\u1ec7n Hugging Face &#8211; m\u1ed9t m\u00f3n \u0111\u1ed3 b\u00e1 \u0111\u1ea1o gi\u00fap ch\u00fang ta l\u00e0m c\u00e1c task NLP v\u00f4 c\u00f9ng \u0111\u01a1n gi\u1ea3n v\u00e0 d\u1ec5 d\u00e0ng.<\/p>\n\n\n\n<p>Hugging Face v\u1edbi slogan c\u1ee7a n\u00f3 l\u00e0 &#8221; On a mission to solve NLP,<br>one commit at a time&#8221; v\u00e0 \u0111\u1ecba ch\u1ec9 trang ch\u00ednh c\u1ee7a n\u00f3 l\u00e0 https:\/\/huggingface.co. Anh em c\u00f3 th\u1ec3 tham kh\u1ea3o th\u00eam t\u1ea1i trang n\u00e0y nh\u00e9.<\/p>\n\n\n\n<p>C\u00f2n b\u00e2y gi\u1edd, let&#8217;s go!<\/p>\n\n\n\n<p>Ch\u00fa \u00fd l\u00e0 ph\u1ea7n n\u00e0y n\u1ebfu b\u1ea1n n\u00e0o ch\u01b0a hi\u1ec3u r\u00f5 c\u00f3 th\u1ec3 h\u1ecfi th\u00eam tr\u00ean Group trao \u0111\u1ed5i, chia s\u1ebb:&nbsp;<strong><a href=\"https:\/\/www.facebook.com\/groups\/miaigroup\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.facebook.com\/groups\/miaigroup<\/a><\/strong> nh\u00e9. C\u00e1c b\u1ea1n n\u00ean clear ph\u1ea7n n\u00e0y \u0111\u1ec3 c\u00f3 th\u1ec3 theo c\u00e1c b\u00e0i ti\u1ebfp theo nha!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Ph\u1ea7n 1 &#8211; C\u00e1c &#8220;d\u1ecb b\u1ea3n&#8221; c\u1ee7a BERT<\/h2>\n\n\n\n<p>Ngay sau khi BERT ra m\u1eaft v\u00e0 t\u1ea1o n\u00ean ti\u1ebfng vang l\u1edbn trong l\u00e0ng NLP, m\u1ed9t lo\u1ea1t c\u00e1c phi\u00ean b\u1ea3n c\u1ea3i ti\u1ebfn, bi\u1ebfn th\u1ec3, d\u1ecb b\u1ea3n nh\u01b0 RoBERTa, ALBERT, DistilBERT,&#8230; \u0111\u01b0\u1ee3c cho ra m\u1eaft v\u1edbi c\u00e1c c\u1ea3i ti\u1ebfn kh\u00e1c nhau v\u1ec1: \u0111\u1ed9 s\u00e2u, s\u1ed1 l\u1edbp, s\u1ed1 head, c\u00e1c ng\u00f4n ng\u1eef kh\u00e1c nhau.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/pbs.twimg.com\/media\/EGCxMK0WwAIxgVU.jpg\" alt=\"\"\/><figcaption>Ngu\u1ed3n: <a href=\"https:\/\/pbs.twimg.com\/media\/EGCxMK0WwAIxgVU.jpg\" target=\"_blank\" rel=\"noreferrer noopener\">T\u1ea1i \u0111\u00e2y<\/a><\/figcaption><\/figure>\n\n\n\n<ins class=\"adsbygoogle\" style=\"display:block\" data-ad-client=\"ca-pub-5095883280136027\" data-ad-slot=\"7735063137\" data-ad-format=\"auto\" data-full-width-responsive=\"true\"><\/ins>\n<script>\n     (adsbygoogle = window.adsbygoogle || []).push({});\n<\/script>\n\n\n\n<p>Ch\u00fang ta c\u0169ng kh\u00f4ng c\u1ea7n t\u00ecm hi\u1ec3u h\u1ebft c\u00e1c phi\u00ean b\u1ea3n BERT tr\u00ean l\u00e0m g\u00ec cho m\u1ec7t, c\u1ea7n c\u00e1i n\u00e0o ta h\u1ecdc c\u00e1i \u0111\u00f3 th\u00f4i. \u0110a ph\u1ea7n v\u1edbi ng\u01b0\u1eddi Vi\u1ec7t ch\u00fang ta th\u00ec s\u1ebd c\u1ea7n 2 m\u00f3n l\u00e0 BERT cho ti\u1ebfng Anh v\u00e0 BERT cho ti\u1ebfng Vi\u1ec7t (PhoBERT) , th\u1ebf l\u00e0 \u0111\u1ee7!<\/p>\n\n\n\n<p>C\u00e1i nay nh\u1ea5t \u1edf \u0111\u00e2y ch\u00ednh l\u00e0 n\u00f3 l\u00e0 pretrain nh\u00e9! Ngh\u0129a l\u00e0 h\u1ecd train r\u1ed3i, ta ch\u1ec9 s\u1eed d\u1ee5ng th\u00f4i (c\u00f2n n\u1ebfu th\u00edch th\u00ec finetune t\u00fd ).<\/p>\n\n\n\n<p>\u0110\u1ebfn \u0111\u00e2y c\u00e1c b\u1ea1n s\u1ebd th\u1eafc m\u1eafc l\u00e0 nhi\u1ec1u phi\u00ean b\u1ea3n th\u1ebf, nhi\u1ec1u m\u00f3n th\u1ebf th\u00ec \u0103n l\u00e0m sao? D\u00f9ng th\u1ebf n\u00e0o? V\u00e0 r\u1ea5t may l\u00e0 \u0111\u00e3 c\u00f3 th\u01b0 vi\u1ec7n si\u00eau d\u1ec5 d\u00f9ng c\u00f3 t\u00ean&nbsp;<a href=\"https:\/\/github.com\/huggingface\/transformers\" target=\"_blank\" rel=\"noreferrer noopener\">Transformers<\/a>&nbsp;c\u1ee7a Hugging Face. (trong b\u00e0i sau s\u1ebd c\u00f3 m\u00f3n https:\/\/simpletransformers.ai )<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Ph\u1ea7n 2 &#8211; Th\u1eed c\u00e0i \u0111\u1eb7t v\u00e0 tr\u00edch xu\u1ea5t \u0111\u1eb7c tr\u01b0ng v\u0103n b\u1ea3n b\u1eb1ng Hugging Face (HF)<\/h2>\n\n\n\n<p>Ok nh\u01b0 v\u1eady qua ph\u1ea7n b\u00ean tr\u00ean c\u00e1c b\u1ea1n ch\u1ec9 c\u1ea7n nh\u1edb l\u00e0 &#8220;C\u00f3 nhi\u1ec1u phi\u00ean b\u1ea3n BERT v\u00e3i l\u00faa nh\u01b0ng ta kh\u00f4ng s\u1ee3 v\u00ec c\u00f3 b\u1ea1n Hugging Face d\u1ec5 th\u01b0\u01a1ng&#8221;.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img decoding=\"async\" src=\"https:\/\/images.squarespace-cdn.com\/content\/v1\/56e2e0c520c6472a2586add2\/1593683608007-L71NCKC2O54GFBHPB0W9\/ke17ZwdGBToddI8pDm48kD-V9xj6iv9l7scRyW6vY8xZw-zPPgdn4jUwVcJE1ZvWQUxwkmyExglNqGp0IvTJZamWLI2zvYWH8K3-s_4yszcp2ryTI0HqTOaaUohrI8PIGg6PmMeUAQfXcmyQNWypzXRzLX6UJF481oOaED98d7UKMshLAGzx4R3EDFOm1kBS\/CP%2BLogos%2B2%2B%25288%2529.jpg\" alt=\"hugging face\"\/><figcaption>Ngu\u1ed3n: <a href=\"https:\/\/images.squarespace-cdn.com\/content\/v1\/56e2e0c520c6472a2586add2\/1593683608007-L71NCKC2O54GFBHPB0W9\/ke17ZwdGBToddI8pDm48kD-V9xj6iv9l7scRyW6vY8xZw-zPPgdn4jUwVcJE1ZvWQUxwkmyExglNqGp0IvTJZamWLI2zvYWH8K3-s_4yszcp2ryTI0HqTOaaUohrI8PIGg6PmMeUAQfXcmyQNWypzXRzLX6UJF481oOaED98d7UKMshLAGzx4R3EDFOm1kBS\/CP%2BLogos%2B2%2B%25288%2529.jpg\" target=\"_blank\" rel=\"noreferrer noopener\">T\u1ea1i \u0111\u00e2y<\/a><\/figcaption><\/figure><\/div>\n\n\n\n<p>B\u00e2y gi\u1edd ch\u00fang ta s\u1ebd c\u00f9ng th\u1eed ngh\u1ecbch HF m\u1ed9t ch\u00fat n\u00e0o . Ch\u00fa \u00fd l\u00e0 \u0111\u00e3 s\u1edd \u0111\u1ebfn BERT th\u00ec c\u00e1c b\u1ea1n n\u00ean chu\u1ea9n b\u1ecb m\u00e1y t\u00ednh c\u00f3 c\u1ea5u h\u00ecnh kh\u00e1 kh\u00e1 m\u1ed9t ch\u00fat nh\u00e9, n\u1ebfu kh\u00f4ng th\u00ec s\u1ebd ch\u1ea1y \u00ec \u1ea1ch l\u1eafm \u0111\u1ea5y.<\/p>\n\n\n\n<p>Trong b\u00e0i n\u00e0y m\u00ecnh ch\u01b0a n\u00f3i g\u00ec \u0111\u1ebfn c\u00e1c task c\u1ee5 th\u1ec3 ph\u00eda sau (Downstream task) nh\u01b0 : Sentiment Classificaiton, Q&amp;A&#8230; M\u00ecnh ch\u1ec9 guide c\u00e1c b\u1ea1n c\u00e1ch c\u00e0i \u0111\u1eb7t, tokenizer, v\u00e0 tr\u00edch xu\u1ea5t \u0111\u1eb7c tr\u01b0ng c\u1ee7a c\u00e2u v\u0103n b\u1ea3n b\u1eb1ng BERT qua th\u01b0 vi\u1ec7n Hugging Face.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">C\u00e0i \u0111\u1eb7t th\u01b0 vi\u1ec7n<\/h4>\n\n\n\n<p>\u0110\u1ec3 s\u1eed d\u1ee5ng \u0111\u01b0\u1ee3c Hugging Face c\u00e1c b\u1ea1n c\u00e0i \u0111\u1eb7t b\u1eb1ng 2 l\u1ec7nh:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code># C\u00e0i \u0111\u1eb7t th\u01b0 vi\u1ec7n transformers c\u1ee7a Huggging Face\npip install transformers\n# C\u00e0i \u0111\u1eb7t pytorch do th\u1eb1ng HF to\u00e0n d\u00f9ng pytorch :D\npip install torch<\/code><\/pre>\n\n\n\n<ins class=\"adsbygoogle\" style=\"display:block\" data-ad-client=\"ca-pub-5095883280136027\" data-ad-slot=\"7735063137\" data-ad-format=\"auto\" data-full-width-responsive=\"true\"><\/ins>\n<script>\n     (adsbygoogle = window.adsbygoogle || []).push({});\n<\/script>\n\n\n\n<h4 class=\"wp-block-heading\">Khai b\u00e1o c\u00e1c th\u01b0 vi\u1ec7n <\/h4>\n\n\n\n<pre class=\"wp-block-code\"><code>import transformers\nimport torch\nfrom transformers import BertModel, BertTokenizer<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\">Load c\u00e1c pretrain model<\/h4>\n\n\n\n<pre class=\"wp-block-code\"><code>model = BertModel.from_pretrained('bert-base-uncased')\ntokenizer = BertTokenizer.from_pretrained('bert-base-uncased')\n<\/code><\/pre>\n\n\n\n<p>Trong hai d\u00f2ng b\u00ean tr\u00ean:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>D\u00f2ng \u0111\u1ea7u ti\u00ean ta load model t\u1eeb BERT pretrain. C\u1ee5 th\u1ec3 \u1edf \u0111\u00e2y l\u00e0 model bert-base (b\u1ea3n nh\u1ecf) v\u00e0 uncased (kh\u00f4ng care vi\u1ebft hoa, th\u01b0\u1eddng)<\/li><li>D\u00f2ng th\u1ee9 hai ta load c\u00e1i Tokenizer. S\u1eed d\u1ee5ng \u0111\u1ec3 tokenize c\u00e1c t\u1eeb trong c\u00e2u.<\/li><\/ul>\n\n\n\n<p>Ch\u00fa \u00fd \u1edf b\u01b0\u1edbc n\u00e0y trong l\u1ea7n ch\u1ea1y \u0111\u1ea7u ti\u00ean s\u1ebd r\u1ea5t ch\u1eadm nh\u00e9. L\u00fd do b\u1edfi v\u00ec hugging face n\u00f3 s\u1ebd t\u1ea3i c\u00e1c pretrain model t\u1eeb internet v\u1ec1, c\u00e1i n\u00e0o c\u0169ng to\u00e0n m\u1ea5y tr\u0103m MB n\u00ean kh\u00f4ng l\u00e2u m\u1edbi l\u00e0 l\u1ea1 \ud83d\ude00<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img decoding=\"async\" src=\"https:\/\/github.com\/thangnch\/photo2\/blob\/main\/Bert01.png?raw=true\" alt=\"hugging face bert\"\/><\/figure><\/div>\n\n\n\n<h4 class=\"wp-block-heading\">Tokenizer c\u00e2u v\u0103n b\u1ea3n<\/h4>\n\n\n\n<p>Nh\u01b0 ch\u00fang ta \u0111\u00e3 bi\u1ebft, m\u00e1y t\u00ednh n\u00f3 ch\u1ec9 hi\u1ec3u s\u1ed1  number m\u00e0 th\u00f4i, n\u00f3 kh\u00f4ng hi\u1ec3u v\u0103n b\u1ea3n, n\u00ean ch\u00fang ta ph\u1ea3i chuy\u1ec3n t\u1eeb c\u00e2u v\u0103n sang m\u1ed9t &#8220;m\u1ea3ng&#8221; c\u00e1c ch\u1eef s\u1ed1, \u0111\u00f3 ch\u00ednh l\u00e0 tokenizer.<\/p>\n\n\n\n<p>\u0110\u1ec3 l\u00e0m vi\u1ec7c \u0111\u00f3, ch\u00fang ta d\u00f9ng \u0111o\u1ea1n l\u1ec7nh sau:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sent = \"I want to learn Python\"\nprint(\"C\u00e2u v\u0103n = \", sent)\ntoken = tokenizer.encode(sent)\nprint(\"Token array = \", token)<\/code><\/pre>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img decoding=\"async\" src=\"https:\/\/github.com\/thangnch\/photo2\/blob\/main\/bert02.png?raw=true\" alt=\"bert hugging face\"\/><\/figure><\/div>\n\n\n\n<p>N\u1ebfu c\u00e1c b\u1ea1n \u0111\u1ec3 \u00fd th\u00ec h\u00ecnh nh\u01b0 token \u0111ang d\u00e0i h\u01a1n C\u00e2u v\u0103n (7 item so v\u1edbi \u0111\u1ed9 d\u00e0i 5 t\u1eeb c\u1ee7a c\u00e2u v\u0103n). \u0110\u00fang \u0111\u00f3, Bert \u0111\u00e3 t\u1ef1 th\u00eam v\u00e0o 2 token \u0111\u1eb7c bi\u1ec7t l\u00e0 [CLS] \u1edf \u0111\u1ea7u c\u00e2u v\u00e0 [SEP] \u1edf cu\u1ed1i c\u00e2u. L\u00fd do v\u00ec sao l\u1ea1i th\u1ebf th\u00ec c\u00e1c b\u1ea1n xem l\u1ea1i b\u00e0i tr\u01b0\u1edbc c\u1ee7a m\u00ecnh <a href=\"https:\/\/www.miai.vn\/2020\/12\/14\/bert-series-chuong-1-bert-la-cai-chi-chi\/\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>t\u1ea1i \u0111\u00e2y<\/strong><\/a> nh\u00e9.<\/p>\n\n\n\n<ins class=\"adsbygoogle\" style=\"display:block\" data-ad-client=\"ca-pub-5095883280136027\" data-ad-slot=\"7735063137\" data-ad-format=\"auto\" data-full-width-responsive=\"true\"><\/ins>\n<script>\n     (adsbygoogle = window.adsbygoogle || []).push({});\n<\/script>\n\n\n\n<p>Ch\u00fang ta th\u1eed d\u1ecbch ng\u01b0\u1ee3c l\u1ea1i xem c\u00f3 \u0111\u00fang ko nh\u00e9:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>d_sent = tokenizer.decode(token)\nprint(\"Decode sentence = \", d_sent)<\/code><\/pre>\n\n\n\n<p>V\u00e0 k\u1ebft qu\u1ea3 chu\u1ea9n lu\u00f4n, \u0111\u00fang l\u00e0 \u0111\u00e3 b\u1ecb th\u00eam 2 m\u00f3n kia v\u00e0o :<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img decoding=\"async\" src=\"https:\/\/github.com\/thangnch\/photo2\/blob\/main\/bert03.png?raw=true\" alt=\"\"\/><\/figure><\/div>\n\n\n\n<h4 class=\"wp-block-heading\">Tr\u00edch xu\u1ea5t \u0111\u1eb7c tr\u01b0ng c\u00e2u v\u0103n<\/h4>\n\n\n\n<p>Okie, v\u1eady l\u00e0 ch\u00fang ta \u0111\u00e3 token, s\u1ed1 h\u00f3a \u0111\u01b0\u1ee3c c\u00e2u v\u0103n r\u1ed3i. Gi\u1edd ch\u00fang ta s\u1ebd \u0111\u01b0a c\u00e2u v\u0103n v\u00e0o BERT \u0111\u1ec3 tr\u00edch ra \u0111\u1eb7c tr\u01b0ng nh\u00e9:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code># Chuy\u1ec3n token array th\u00e0nh tensor\nsent_tensor = torch.tensor(&#91;token])\nprint(sent_tensor.size())\n\n# X\u00e2y d\u1ef1ng attention_mask, \u1edf \u0111\u00e2y l\u00e0 m\u1ea3ng to\u00e0n 1 v\u00ec ta quan t\u00e2m \u0111\u1ebfn all c\u00e1c token\nattention_mask = torch.tensor(&#91;np.ones(7)])\nprint(attention_mask.size())\n\n# Tr\u00edch \u0111\u1eb7c tr\u01b0ng\nwith torch.no_grad():\n    last_hidden_states = model(input_ids = sent_tensor, attention_mask = attention_mask)\n\n# In k\u00edch th\u01b0\u1edbc v\u00e0 gi\u00e1 tr\u1ecb \u0111\u1eb7c tr\u01b0ng ra m\u00e0n h\u00ecnh\nprint(last_hidden_states&#91;0].size())\nprint(last_hidden_states&#91;0])<\/code><\/pre>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/github.com\/thangnch\/photo2\/blob\/main\/bert04.png?raw=true\" alt=\"\"\/><\/figure>\n\n\n\n<p>Ch\u1ed7 n\u00e0y c\u00f3 m\u1ea5y \u0111i\u1ec3m c\u00e1c b\u1ea1n c\u1ea7n l\u01b0u \u00fd:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Th\u1ee9 nh\u1ea5t, trong pytorch ra d\u00f9ng l\u1ec7nh .size() \u0111\u1ec3 in ra k\u00edch th\u01b0\u1edbc tensor.<\/li><li>Th\u1ee9 hai, attention mask l\u00e0 g\u00ec? \u0110\u00f3 l\u00e0 m\u1ed9t ma tr\u1eadn\/vector c\u00f3 k\u00edch th\u01b0\u1edbc b\u1eb1ng v\u1edbi vector token v\u00e0 c\u00f3 gi\u00e1 tr\u1ecb l\u00e0 0\/1 \u0111\u1ec3 ch\u1ec9 ra c\u00e1c token n\u00e0o Bert c\u1ea7n quan t\u00e2m v\u00e0 token n\u00e0o kh\u00f4ng c\u1ea7n quan t\u00e2m. Trong tr\u01b0\u1eddng h\u1ee3p n\u00e0y, ch\u00fang ta quan t\u00e2m all c\u00e1c token n\u00ean \u0111\u1ec3 l\u00e0 1 h\u1ebft. Khi ch\u00fang ta x\u1eed l\u00fd nhi\u1ec1u c\u00e2u v\u0103n b\u1ea3n c\u00f3 \u0111\u1ed9 d\u00e0i kh\u00e1c nhau, ta s\u1ebd padding th\u00eam c\u00e1c gi\u00e1 tr\u1ecb \u0111\u1eb7c bi\u1ec7t, v\u00e0 khi \u0111\u00f3 ta b\u1ea3o model l\u00e0 : h\u00e3y \u0111\u1eebng quan t\u00e2m \u0111\u1ebfn c\u00e1c c\u00e1i tao padding th\u00eam v\u00e0o b\u1eb1ng c\u00e1ch set c\u00e1c gi\u00e1 tr\u1ecb t\u01b0\u01a1ng \u1ee9ng trong attetion mask = 0 \ud83d\ude00<\/li><li>Th\u1ee9 ba, output embedding m\u00e0 ch\u00fang ta mong mu\u1ed1n s\u1ebd c\u00f3 size l\u00e0 (1,7,768) . \u0110i\u1ec1u n\u00e0y c\u00f3 ngh\u0129a l\u00e0 c\u00f3 t\u1ea5t c\u1ea3 7 embedding vector cho 7 t\u1eeb trong c\u00e2u (bao g\u1ed3m c\u1ea3 2 c\u00e1i t\u1eeb \u0111\u1eb7c bi\u1ec7t [CLS] v\u00e0 [SEP] \u0111\u00f3) v\u00e0 m\u1ed7i vector c\u00f3 \u0111\u1ed9 d\u00e0i 768.<\/li><\/ul>\n\n\n\n<ins class=\"adsbygoogle\" style=\"display:block\" data-ad-client=\"ca-pub-5095883280136027\" data-ad-slot=\"7735063137\" data-ad-format=\"auto\" data-full-width-responsive=\"true\"><\/ins>\n<script>\n     (adsbygoogle = window.adsbygoogle || []).push({});\n<\/script>\n\n\n\n<p>R\u1ed3i, b\u00e2y gi\u1edd ch\u00fang ta \u0111\u00e3 tr\u00edch \u0111\u01b0\u1ee3c \u0111\u1eb7c tr\u01b0ng cho c\u00e2u v\u0103n b\u1ea3n b\u1eb1ng BERT. Trong c\u00e1c b\u00e0i ti\u1ebfp theo, ch\u00fang ta s\u1ebd d\u00f9ng to\u00e0n b\u1ed9 output embedding ho\u1eb7c ch\u1ec9 d\u00f9ng vector embedding t\u1ea1i v\u1ecb tr\u00ed token [CLS] (v\u1ecb tr\u00ed 0) \u0111\u1ec3 x\u1eed l\u00fd ti\u1ebfp.<\/p>\n\n\n\n<p>Ph\u1ea7n n\u00e0y n\u1ebfu b\u1ea1n n\u00e0o ch\u01b0a hi\u1ec3u r\u00f5 c\u00f3 th\u1ec3 h\u1ecfi th\u00eam tr\u00ean Group trao \u0111\u1ed5i, chia s\u1ebb:&nbsp;<strong><a href=\"https:\/\/www.facebook.com\/groups\/miaigroup\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.facebook.com\/groups\/miaigroup<\/a><\/strong> nh\u00e9. C\u00e1c b\u1ea1n n\u00ean clear ph\u1ea7n n\u00e0y \u0111\u1ec3 c\u00f3 th\u1ec3 theo c\u00e1c b\u00e0i ti\u1ebfp theo nha!<\/p>\n\n\n\n<p>H\u1eb9n c\u00e1c b\u1ea1n trong c\u00e1c b\u00e0i ti\u1ebfp theo nha!<\/p>\n\n\n\n<p>Ch\u00fac c\u00e1c b\u1ea1n th\u00e0nh c\u00f4ng!<\/p>\n\n\n\n<p>#M\u00ecAI<\/p>\n\n\n\n<p>Fanpage:&nbsp;<a href=\"http:\/\/facebook.com\/miaiblog\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>http:\/\/facebook.com\/miaiblog<\/strong><\/a><br>Group trao \u0111\u1ed5i, chia s\u1ebb:&nbsp;<a href=\"https:\/\/www.facebook.com\/groups\/miaigroup\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>https:\/\/www.facebook.com\/groups\/miaigroup<\/strong><\/a><br>Website:&nbsp;<a href=\"http:\/\/miai.vn\/\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>https:\/\/miai.vn\/<\/strong><\/a><br>Youtube:&nbsp;<a href=\"http:\/\/bit.ly\/miaiyoutube\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>http:\/\/bit.ly\/miaiyoutube<\/strong><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Ch\u00e0o c\u00e1c anh em, h\u00f4m nay ch\u00fang ta s\u1ebd c\u00f9ng t\u00ecm hi\u1ec3u v\u1ec1 th\u01b0 vi\u1ec7n Hugging Face &#8211; m\u1ed9t m\u00f3n \u0111\u1ed3 b\u00e1 \u0111\u1ea1o gi\u00fap ch\u00fang ta l\u00e0m c\u00e1c task NLP v\u00f4 c\u00f9ng \u0111\u01a1n gi\u1ea3n v\u00e0 d\u1ec5 d\u00e0ng. Hugging Face v\u1edbi slogan c\u1ee7a n\u00f3 l\u00e0 &#8221; On a mission to solve NLP,one commit at a time&#8221; [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[67],"tags":[448,450,449,68,69,444,265],"class_list":["post-1317","post","type-post","status-publish","format-standard","hentry","category-natural-language-processing","tag-bert","tag-hugging-face","tag-natural-language-processing","tag-nature-language-processing","tag-nlp","tag-transformer","tag-xu-ly-ngon-ngu-tu-nhien"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face - M\u00ec AI<\/title>\n<meta name=\"description\" content=\"H\u00f4m nay ch\u00fang ta s\u1ebd c\u00f9ng t\u00ecm hi\u1ec3u v\u1ec1 th\u01b0 vi\u1ec7n Hugging Face - m\u1ed9t m\u00f3n \u0111\u1ed3 b\u00e1 \u0111\u1ea1o gi\u00fap ch\u00fang ta l\u00e0m c\u00e1c task NLP v\u00f4 c\u00f9ng \u0111\u01a1n gi\u1ea3n v\u00e0 d\u1ec5 d\u00e0ng.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/miai.vn\/?p=1317\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face - M\u00ec AI\" \/>\n<meta property=\"og:description\" content=\"H\u00f4m nay ch\u00fang ta s\u1ebd c\u00f9ng t\u00ecm hi\u1ec3u v\u1ec1 th\u01b0 vi\u1ec7n Hugging Face - m\u1ed9t m\u00f3n \u0111\u1ed3 b\u00e1 \u0111\u1ea1o gi\u00fap ch\u00fang ta l\u00e0m c\u00e1c task NLP v\u00f4 c\u00f9ng \u0111\u01a1n gi\u1ea3n v\u00e0 d\u1ec5 d\u00e0ng.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/miai.vn\/?p=1317\" \/>\n<meta property=\"og:site_name\" content=\"M\u00ec AI\" \/>\n<meta property=\"article:published_time\" content=\"2020-12-21T21:26:07+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/pbs.twimg.com\/media\/EGCxMK0WwAIxgVU.jpg\" \/>\n<meta name=\"author\" content=\"Ch\u1ee7 ti\u1ec7m M\u00ec\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Ch\u1ee7 ti\u1ec7m M\u00ec\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/miai.vn\\\/?p=1317#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/miai.vn\\\/?p=1317\"},\"author\":{\"name\":\"Ch\u1ee7 ti\u1ec7m M\u00ec\",\"@id\":\"https:\\\/\\\/miai.vn\\\/#\\\/schema\\\/person\\\/cc8bc24bb90bd3f596add82f3a59948c\"},\"headline\":\"[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face\",\"datePublished\":\"2020-12-21T21:26:07+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/miai.vn\\\/?p=1317\"},\"wordCount\":1468,\"commentCount\":3,\"publisher\":{\"@id\":\"https:\\\/\\\/miai.vn\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/miai.vn\\\/?p=1317#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/pbs.twimg.com\\\/media\\\/EGCxMK0WwAIxgVU.jpg\",\"keywords\":[\"bert\",\"hugging face\",\"natural language processing\",\"Nature Language Processing\",\"NLP\",\"transformer\",\"X\u1eed l\u00fd ng\u00f4n ng\u1eef t\u1ef1 nhi\u00ean\"],\"articleSection\":[\"Natural Language Processing\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/miai.vn\\\/?p=1317#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/miai.vn\\\/?p=1317\",\"url\":\"https:\\\/\\\/miai.vn\\\/?p=1317\",\"name\":\"[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face - M\u00ec AI\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/miai.vn\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/miai.vn\\\/?p=1317#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/miai.vn\\\/?p=1317#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/pbs.twimg.com\\\/media\\\/EGCxMK0WwAIxgVU.jpg\",\"datePublished\":\"2020-12-21T21:26:07+00:00\",\"description\":\"H\u00f4m nay ch\u00fang ta s\u1ebd c\u00f9ng t\u00ecm hi\u1ec3u v\u1ec1 th\u01b0 vi\u1ec7n Hugging Face - m\u1ed9t m\u00f3n \u0111\u1ed3 b\u00e1 \u0111\u1ea1o gi\u00fap ch\u00fang ta l\u00e0m c\u00e1c task NLP v\u00f4 c\u00f9ng \u0111\u01a1n gi\u1ea3n v\u00e0 d\u1ec5 d\u00e0ng.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/miai.vn\\\/?p=1317#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/miai.vn\\\/?p=1317\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/miai.vn\\\/?p=1317#primaryimage\",\"url\":\"https:\\\/\\\/pbs.twimg.com\\\/media\\\/EGCxMK0WwAIxgVU.jpg\",\"contentUrl\":\"https:\\\/\\\/pbs.twimg.com\\\/media\\\/EGCxMK0WwAIxgVU.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/miai.vn\\\/?p=1317#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/miai.vn\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/miai.vn\\\/#website\",\"url\":\"https:\\\/\\\/miai.vn\\\/\",\"name\":\"M\u00ec AI\",\"description\":\"H\u1ecdc AI theo c\u00e1ch M\u00ec \u0103n li\u1ec1n!\",\"publisher\":{\"@id\":\"https:\\\/\\\/miai.vn\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/miai.vn\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/miai.vn\\\/#organization\",\"name\":\"M\u00ec AI\",\"url\":\"https:\\\/\\\/miai.vn\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/miai.vn\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/miai.vn\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/cropped-Logo_w_slogan.png\",\"contentUrl\":\"https:\\\/\\\/miai.vn\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/cropped-Logo_w_slogan.png\",\"width\":240,\"height\":193,\"caption\":\"M\u00ec AI\"},\"image\":{\"@id\":\"https:\\\/\\\/miai.vn\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/miai.vn\\\/#\\\/schema\\\/person\\\/cc8bc24bb90bd3f596add82f3a59948c\",\"name\":\"Ch\u1ee7 ti\u1ec7m M\u00ec\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b0b5124b0d2c0a8054d7127d2c236bdc3dc7a50e2d4e8728ab32eee5b122a8d1?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b0b5124b0d2c0a8054d7127d2c236bdc3dc7a50e2d4e8728ab32eee5b122a8d1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/b0b5124b0d2c0a8054d7127d2c236bdc3dc7a50e2d4e8728ab32eee5b122a8d1?s=96&d=mm&r=g\",\"caption\":\"Ch\u1ee7 ti\u1ec7m M\u00ec\"},\"sameAs\":[\"https:\\\/\\\/miai.vn\"],\"url\":\"https:\\\/\\\/miai.vn\\\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face - M\u00ec AI","description":"H\u00f4m nay ch\u00fang ta s\u1ebd c\u00f9ng t\u00ecm hi\u1ec3u v\u1ec1 th\u01b0 vi\u1ec7n Hugging Face - m\u1ed9t m\u00f3n \u0111\u1ed3 b\u00e1 \u0111\u1ea1o gi\u00fap ch\u00fang ta l\u00e0m c\u00e1c task NLP v\u00f4 c\u00f9ng \u0111\u01a1n gi\u1ea3n v\u00e0 d\u1ec5 d\u00e0ng.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/miai.vn\/?p=1317","og_locale":"en_US","og_type":"article","og_title":"[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face - M\u00ec AI","og_description":"H\u00f4m nay ch\u00fang ta s\u1ebd c\u00f9ng t\u00ecm hi\u1ec3u v\u1ec1 th\u01b0 vi\u1ec7n Hugging Face - m\u1ed9t m\u00f3n \u0111\u1ed3 b\u00e1 \u0111\u1ea1o gi\u00fap ch\u00fang ta l\u00e0m c\u00e1c task NLP v\u00f4 c\u00f9ng \u0111\u01a1n gi\u1ea3n v\u00e0 d\u1ec5 d\u00e0ng.","og_url":"https:\/\/miai.vn\/?p=1317","og_site_name":"M\u00ec AI","article_published_time":"2020-12-21T21:26:07+00:00","og_image":[{"url":"https:\/\/pbs.twimg.com\/media\/EGCxMK0WwAIxgVU.jpg","type":"","width":"","height":""}],"author":"Ch\u1ee7 ti\u1ec7m M\u00ec","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Ch\u1ee7 ti\u1ec7m M\u00ec","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/miai.vn\/?p=1317#article","isPartOf":{"@id":"https:\/\/miai.vn\/?p=1317"},"author":{"name":"Ch\u1ee7 ti\u1ec7m M\u00ec","@id":"https:\/\/miai.vn\/#\/schema\/person\/cc8bc24bb90bd3f596add82f3a59948c"},"headline":"[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face","datePublished":"2020-12-21T21:26:07+00:00","mainEntityOfPage":{"@id":"https:\/\/miai.vn\/?p=1317"},"wordCount":1468,"commentCount":3,"publisher":{"@id":"https:\/\/miai.vn\/#organization"},"image":{"@id":"https:\/\/miai.vn\/?p=1317#primaryimage"},"thumbnailUrl":"https:\/\/pbs.twimg.com\/media\/EGCxMK0WwAIxgVU.jpg","keywords":["bert","hugging face","natural language processing","Nature Language Processing","NLP","transformer","X\u1eed l\u00fd ng\u00f4n ng\u1eef t\u1ef1 nhi\u00ean"],"articleSection":["Natural Language Processing"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/miai.vn\/?p=1317#respond"]}]},{"@type":"WebPage","@id":"https:\/\/miai.vn\/?p=1317","url":"https:\/\/miai.vn\/?p=1317","name":"[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face - M\u00ec AI","isPartOf":{"@id":"https:\/\/miai.vn\/#website"},"primaryImageOfPage":{"@id":"https:\/\/miai.vn\/?p=1317#primaryimage"},"image":{"@id":"https:\/\/miai.vn\/?p=1317#primaryimage"},"thumbnailUrl":"https:\/\/pbs.twimg.com\/media\/EGCxMK0WwAIxgVU.jpg","datePublished":"2020-12-21T21:26:07+00:00","description":"H\u00f4m nay ch\u00fang ta s\u1ebd c\u00f9ng t\u00ecm hi\u1ec3u v\u1ec1 th\u01b0 vi\u1ec7n Hugging Face - m\u1ed9t m\u00f3n \u0111\u1ed3 b\u00e1 \u0111\u1ea1o gi\u00fap ch\u00fang ta l\u00e0m c\u00e1c task NLP v\u00f4 c\u00f9ng \u0111\u01a1n gi\u1ea3n v\u00e0 d\u1ec5 d\u00e0ng.","breadcrumb":{"@id":"https:\/\/miai.vn\/?p=1317#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/miai.vn\/?p=1317"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/miai.vn\/?p=1317#primaryimage","url":"https:\/\/pbs.twimg.com\/media\/EGCxMK0WwAIxgVU.jpg","contentUrl":"https:\/\/pbs.twimg.com\/media\/EGCxMK0WwAIxgVU.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/miai.vn\/?p=1317#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/miai.vn\/"},{"@type":"ListItem","position":2,"name":"[BERT Series] Ch\u01b0\u01a1ng 2. Ngh\u1ecbch m\u1ed9t ch\u00fat v\u1edbi Hugging Face"}]},{"@type":"WebSite","@id":"https:\/\/miai.vn\/#website","url":"https:\/\/miai.vn\/","name":"M\u00ec AI","description":"H\u1ecdc AI theo c\u00e1ch M\u00ec \u0103n li\u1ec1n!","publisher":{"@id":"https:\/\/miai.vn\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/miai.vn\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/miai.vn\/#organization","name":"M\u00ec AI","url":"https:\/\/miai.vn\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/miai.vn\/#\/schema\/logo\/image\/","url":"https:\/\/miai.vn\/wp-content\/uploads\/2026\/05\/cropped-Logo_w_slogan.png","contentUrl":"https:\/\/miai.vn\/wp-content\/uploads\/2026\/05\/cropped-Logo_w_slogan.png","width":240,"height":193,"caption":"M\u00ec AI"},"image":{"@id":"https:\/\/miai.vn\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/miai.vn\/#\/schema\/person\/cc8bc24bb90bd3f596add82f3a59948c","name":"Ch\u1ee7 ti\u1ec7m M\u00ec","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/b0b5124b0d2c0a8054d7127d2c236bdc3dc7a50e2d4e8728ab32eee5b122a8d1?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/b0b5124b0d2c0a8054d7127d2c236bdc3dc7a50e2d4e8728ab32eee5b122a8d1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b0b5124b0d2c0a8054d7127d2c236bdc3dc7a50e2d4e8728ab32eee5b122a8d1?s=96&d=mm&r=g","caption":"Ch\u1ee7 ti\u1ec7m M\u00ec"},"sameAs":["https:\/\/miai.vn"],"url":"https:\/\/miai.vn\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/miai.vn\/index.php?rest_route=\/wp\/v2\/posts\/1317","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/miai.vn\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/miai.vn\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/miai.vn\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/miai.vn\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1317"}],"version-history":[{"count":0,"href":"https:\/\/miai.vn\/index.php?rest_route=\/wp\/v2\/posts\/1317\/revisions"}],"wp:attachment":[{"href":"https:\/\/miai.vn\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1317"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/miai.vn\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1317"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/miai.vn\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1317"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}