๋Œ€ํšŒ ํ”„๋กœ์ ํŠธ 5

fastAPI pydamic์œผ๋กœ ์Šคํ‚ค๋งˆ ์„ค์ •ํ•˜๊ธฐ

schema.py ์— Pydantic ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•˜์—ฌ ์š”์ฒญ ๋ฐ ์‘๋‹ต ์Šคํ‚ค๋งˆ๋ฅผ ์ •์˜ ์˜ˆ์‹œ: from pydantic import BaseModel from typing import Optional class JapaneseBase(BaseModel): type: Optional[str] = None letter: str pronounciation: str audio: Optional[str] = None lesson: Optional[int] = None img: Optional[str] = None # ์„ ํƒ์  ํ•„๋“œ vid: Optional[str] = None # ์„ ํƒ์  ํ•„๋“œ class JapaneseCreate(JapaneseBase): pass ๋‹ค์‹œ routers/ ํด๋”์˜ ํ•ด๋‹น ํŒŒ์ผ๋กœ๊ฐ€์„œ, ๋ผ์šฐํ„ฐ์— ..

๊ฐ์ • ๋ถ„๋ฅ˜ ๋ชจ๋ธ ๋งŒ๋“ค๊ณ  ์„ฑ๋Šฅ ๊ฐœ์„ ๊นŒ์ง€ (BERT, GPT2, RoBERTa, DistilBERT)

๊ฐ„๋‹จํ•œ ๊ธ๋ถ€์ • ์ด์ง„ ๋ถ„๋ฅ˜ ๋ชจ๋ธ์„ ๋งŒ๋“ค์—ˆ๋‹ค. ์ „์ฒด์ฝ”๋“œ๋Š” ๊นƒํ—™์—์„œ ๋ณผ ์ˆ˜ ์žˆ๋‹ค! https://github.com/Juyoung-b/Improving-the-Performance-of-Sentiment-Classification GitHub - Juyoung-b/Improving-the-Performance-of-Sentiment-Classification Contribute to Juyoung-b/Improving-the-Performance-of-Sentiment-Classification development by creating an account on GitHub. github.com ์˜์–ด๋กœ ๋œ ๋ ˆ์Šคํ† ๋ž‘ ๋ฆฌ๋ทฐ๋ฅผ ๊ฐ€์ง€๊ณ , ๊ธ์ •(1), ๋ถ€์ •(0)์œผ๋กœ ๋ถ„๋ฅ˜ํ•˜๋Š” ๊ฐ„๋‹จํ•œ task ๋ชจ๋ธ์ด๋‹ค. ์ด๋ฒˆ ํ”„๋กœ์ ํŠธ์—์„ ..

BERT๋กœ ๋‰ด์Šค ๊ธฐ์‚ฌ ์นดํ…Œ๊ณ ๋ฆฌ ๋ถ„๋ฅ˜ํ•˜๊ธฐ

์ž‘์—… ์ธ์› : 1๋ช…, ์†Œ์š”๊ธฐ๊ฐ„ : 1์ผ, ์ž‘์—…ํ™˜๊ฒฝ : google colab, python, KoBERT, ๋ฐ์ดํ„ฐ : ๋‰ด์Šค๊ธฐ์‚ฌ ํ…์Šคํฌ์™€ ํ•ด๋‹น ์นดํ…Œ๊ณ ๋ฆฌ ์ •ํ™•๋„ 0.847, F1 Score - 0.845 ์ž์—ฐ์–ด์ฒ˜๋ฆฌ์—์„œ ๋ถ„๋ฅ˜์— ์‚ฌ์šฉ๋˜๋Š” ๋ชจ๋ธ์€ ๊ฐ„๋‹จํ•œ RNN, LSTM๋ถ€ํ„ฐ BERT , ๋“ฑ ๋‹ค์–‘ํ•œ ๋ชจ๋ธ์ด ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋ฒˆ์—๋Š” KoBERT๋ฅผ ์‚ฌ์šฉํ•ด์„œ Fine-tuningํ•ด๋ณด์•˜๋Š”๋ฐ, KoBERT๋Š” BERT์— ํ•œ๊ตญ์–ด ๋ฐ์ดํ„ฐ๋ฅผ ์ถ”๊ฐ€๋กœ ๋” ํ•™์Šต์‹œํ‚จ ๋ชจ๋ธ๋กœ ํ•œ๊ตญ์–ด์— ๋” ์ข‹์€ ์„ฑ๋Šฅ์„ ๋ณด์ด๋Š” ๊ฒƒ์ด ํŠน์ง•์ž…๋‹ˆ๋‹ค. ์•„๋ž˜ ๋งํฌ์—์„œ ๋ชจ๋ธ์„ ๋ณผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. https://github.com/SKTBrain/KoBERT ๋ถ„๋ฅ˜ ์นดํ…Œ๊ณ ๋ฆฌ๋Š” ์ด 6๊ฐ€์ง€ ์ž…๋‹ˆ๋‹ค. ('๊ฒฝ์ œ', '์‚ฌํšŒ', '์ƒํ™œ', '์Šคํฌ์ธ ', '์—ฐ์˜ˆ/๋ฌธํ™”', '์ •์น˜') ์‹คํ–‰ ์ „ ์ฝ”..

kaggle ์‹ ์šฉ์นด๋“œ ๊ฑฐ๋ž˜ ์ด์ƒ ํƒ์ง€ (๋ถ„๋ฅ˜, ๋กœ์ง€์Šคํ‹ฑ ํšŒ๊ท€)

https://www.kaggle.com/datasets/mlg-ulb/creditcardfraud Credit Card Fraud Detection Anonymized credit card transactions labeled as fraudulent or genuine www.kaggle.com ๋Œ€ํšŒ๋ฌธ์ œ: ์ƒ๋‹จ ๋งํฌ ๋กœ์ง€์Šคํ‹ฑ ํšŒ๊ท€๋ฅผ ๊ณต๋ถ€ํ•˜๊ณ , ์‹ค์ œ๋กœ ์ ์šฉํ•ด๋ณด๊ณ  ์‹ถ์–ด์„œ ์บ๊ธ€์—์„œ ๋ฌธ์ œ๋ฅผ ํ•˜๋‚˜ ๊ณจ๋ผ ํ’€์–ด๋ดค๋‹ค. ์‹ ์šฉ์นด๋“œ ๊ฑฐ๋ž˜๊ฐ€ ์‚ฌ๊ธฐ๊ฑฐ๋ž˜์ธ์ง€, ์ •์ƒ๊ฑฐ๋ž˜์ธ์ง€ ์‹๋ณ„ํ•˜๋Š” ๋ฌธ์ œ๋กœ, ์นด๋“œ์‚ฌ๊ฐ€ ์ด์ƒ ์žˆ๋Š” ์นด๋“œ ๊ฑฐ๋ž˜๋ฅผ ์ธ์‹ ํ•˜์—ฌ ๊ณ ๊ฐ์ด ๊ตฌ๋งคํ•˜์ง€ ์•Š์€ ํ•ญ๋ชฉ์— ๋Œ€ํ•ด์„œ๋Š” ๋น„์šฉ์ด ์ฒญ๊ตฌ๋˜์ง€ ์•Š๋„๋ก ํ•˜๋Š” ๊ฒƒ์ด ๋ชฉํ‘œ์ด๋‹ค. ๋ฐ์ดํ„ฐ ์…‹์€ ์ดํ‹€์น˜ ๊ฑฐ๋ž˜๋กœ, 248,807๊ฑด์˜ ๊ฑฐ๋ž˜์ค‘ 492๊ฑด์˜ ์‚ฌ๊ธฐ๊ฐ€ ์žˆ๋‹ค. Class์นผ๋Ÿผ์— 0,1๋กœ ํ‘œ๊ธฐ๋˜์–ด์žˆ๋‹ค..

[kaggle competition1]Store Sales - Time Series Forecasting Use machine learning to predict grocery sales 1-๋ณ€์ˆ˜์„ค๋ช…

https://www.kaggle.com/competitions/store-sales-time-series-forecasting Store Sales - Time Series Forecasting | Kaggle www.kaggle.com ๋Œ€ํšŒ ๊ฐœ์š” - ์—์ฝฐ๋„๋ฅด์— ์œ„์น˜ํ•œ Favorita ๋งค์žฅ์—์„œ ํŒ๋งค๋˜๋Š” ์ˆ˜์ฒœ ๊ฐœ์˜ ์ œํ’ˆ๊ตฐ์˜ ๋งค์ถœ์„ ์˜ˆ์ธก ๋ฐ์ดํ„ฐ ์…‹,๋ณ€์ˆ˜ ์„ค๋ช… 1. train.csv - store_nbr : ์ œํ’ˆ์ด ํŒ๋งค๋˜๋Š” ์Šคํ† ์–ด id family : ํŒ๋งค๋˜๋Š” ์ œํ’ˆ์˜ ์ข…๋ฅ˜ ๋”๋ณด๊ธฐ ( ['AUTOMOTIVE', 'BABY CARE', 'BEAUTY', 'BEVERAGES', 'BOOKS', 'BREAD/BAKERY', 'CELEBRATION', 'CLEANING', 'DAIRY', 'DELI', 'EGGS',..