๋Œ€ํšŒ ํ”„๋กœ์ ํŠธ/ํ”„๋กœ์ ํŠธ 2

๊ฐ์ • ๋ถ„๋ฅ˜ ๋ชจ๋ธ ๋งŒ๋“ค๊ณ  ์„ฑ๋Šฅ ๊ฐœ์„ ๊นŒ์ง€ (BERT, GPT2, RoBERTa, DistilBERT)

๊ฐ„๋‹จํ•œ ๊ธ๋ถ€์ • ์ด์ง„ ๋ถ„๋ฅ˜ ๋ชจ๋ธ์„ ๋งŒ๋“ค์—ˆ๋‹ค. ์ „์ฒด์ฝ”๋“œ๋Š” ๊นƒํ—™์—์„œ ๋ณผ ์ˆ˜ ์žˆ๋‹ค! https://github.com/Juyoung-b/Improving-the-Performance-of-Sentiment-Classification GitHub - Juyoung-b/Improving-the-Performance-of-Sentiment-Classification Contribute to Juyoung-b/Improving-the-Performance-of-Sentiment-Classification development by creating an account on GitHub. github.com ์˜์–ด๋กœ ๋œ ๋ ˆ์Šคํ† ๋ž‘ ๋ฆฌ๋ทฐ๋ฅผ ๊ฐ€์ง€๊ณ , ๊ธ์ •(1), ๋ถ€์ •(0)์œผ๋กœ ๋ถ„๋ฅ˜ํ•˜๋Š” ๊ฐ„๋‹จํ•œ task ๋ชจ๋ธ์ด๋‹ค. ์ด๋ฒˆ ํ”„๋กœ์ ํŠธ์—์„ ..

BERT๋กœ ๋‰ด์Šค ๊ธฐ์‚ฌ ์นดํ…Œ๊ณ ๋ฆฌ ๋ถ„๋ฅ˜ํ•˜๊ธฐ

์ž‘์—… ์ธ์› : 1๋ช…, ์†Œ์š”๊ธฐ๊ฐ„ : 1์ผ, ์ž‘์—…ํ™˜๊ฒฝ : google colab, python, KoBERT, ๋ฐ์ดํ„ฐ : ๋‰ด์Šค๊ธฐ์‚ฌ ํ…์Šคํฌ์™€ ํ•ด๋‹น ์นดํ…Œ๊ณ ๋ฆฌ ์ •ํ™•๋„ 0.847, F1 Score - 0.845 ์ž์—ฐ์–ด์ฒ˜๋ฆฌ์—์„œ ๋ถ„๋ฅ˜์— ์‚ฌ์šฉ๋˜๋Š” ๋ชจ๋ธ์€ ๊ฐ„๋‹จํ•œ RNN, LSTM๋ถ€ํ„ฐ BERT , ๋“ฑ ๋‹ค์–‘ํ•œ ๋ชจ๋ธ์ด ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋ฒˆ์—๋Š” KoBERT๋ฅผ ์‚ฌ์šฉํ•ด์„œ Fine-tuningํ•ด๋ณด์•˜๋Š”๋ฐ, KoBERT๋Š” BERT์— ํ•œ๊ตญ์–ด ๋ฐ์ดํ„ฐ๋ฅผ ์ถ”๊ฐ€๋กœ ๋” ํ•™์Šต์‹œํ‚จ ๋ชจ๋ธ๋กœ ํ•œ๊ตญ์–ด์— ๋” ์ข‹์€ ์„ฑ๋Šฅ์„ ๋ณด์ด๋Š” ๊ฒƒ์ด ํŠน์ง•์ž…๋‹ˆ๋‹ค. ์•„๋ž˜ ๋งํฌ์—์„œ ๋ชจ๋ธ์„ ๋ณผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. https://github.com/SKTBrain/KoBERT ๋ถ„๋ฅ˜ ์นดํ…Œ๊ณ ๋ฆฌ๋Š” ์ด 6๊ฐ€์ง€ ์ž…๋‹ˆ๋‹ค. ('๊ฒฝ์ œ', '์‚ฌํšŒ', '์ƒํ™œ', '์Šคํฌ์ธ ', '์—ฐ์˜ˆ/๋ฌธํ™”', '์ •์น˜') ์‹คํ–‰ ์ „ ์ฝ”..