ํฌ์ŠคํŠธ

๐ŸŒ’ Adaptive Resonance Theory - ART1

5, 6์ฐจ์‹œ
@ 50๋ถ„ ์ •๋„์˜ ์ง‘์ค‘๋ ฅ

๐Ÿ’ซ ์„œ๋ก 


Resonance ๊ณต๋ช…

๋ชจ๋“  ๋ฌผ์ฒด๋Š” ๊ณ ์œ ํ•œ ์ง„๋™์ˆ˜๋ฅผ ๊ฐ€์ง„๋‹ค
์ง„๋™์ˆ˜ : 1์ดˆ์— ์ง„๋™ํ•˜๋Š” ์ˆ˜, Hz

๊ณต๋ช… : ๊ฐ™์ด ์šด๋‹ค
โ†’ ๊ฐ™์€ ์ง„๋™์ˆ˜์˜ ๋ฌผ์ฒด๊ฐ€ ์ฃผ๋ณ€์—์„œ ์ง„๋™ํ•˜๋ฉด, ํ•จ๊ป˜ ์ง„๋™ํ•œ๋‹ค
โ†’ ์ง„๋™์ˆ˜๊ฐ€ ๋‹ค๋ฅด๋ฉด ๊ณต๋ช…ํ•˜์ง€ ์•Š๋Š”๋‹ค
โ†’ ๊นจ๊ตฌ๋ฝ์ง€์˜ ๊ณต๋ช… : ์ผ€๋กœ์ผ€๋กœ์ผ€๋กœโ€ฆ

Adaptive ์ ์‘ํ˜•
@ LOL ์ ์‘ํ˜• ๋Šฅ๋ ฅ์น˜ : Adaptive Force

๐Ÿ’ซ Adaptive Resonance Theory - ART1


์ ์‘ํ˜• ๊ณต๋ช…
โ†’ ๊ธฐ์ค€๊ณผ ๊ณต๋ช…ํ•˜๋Š” ๊ฒƒ๋“ค์„ ์ฐพ์•„ ๊ทธ๋ฃนํ™” (๋ฐ˜๋ณต)
โ†’ Recommender System - ์ถ”์ฒœ

Adaptive Resonance Theory - ART1
โ†’ Clustering Algorithms - ๊ตฐ์ง‘ํ™” ์•Œ๊ณ ๋ฆฌ๋“ฌ
โ†’ Unsupervised Learning Algorithm - ๋น„์ง€๋„ ํ•™์Šต ์•Œ๊ณ ๋ฆฌ์ฆ˜ (With Biological Motivations)

Supervise ์ง€๋„
@ Supervised User

์ง€๋„ ํ•™์Šต :
๋‹ต์ด ์ด๋ฏธ ์กด์žฌํ•˜๋Š”, ๋ˆ„๊ฐ€ ์ง€๋„ํ•ด์ฃผ๋Š” (Supervised)
@ ๋ถ„๋ฅ˜, ๋ˆ„๊ฐ€ ๋ˆ„๊ตฌ๋‹ค

๋น„์ง€๋„ ํ•™์Šต :
๋‹ต์ด ์—†๋Š” (๋น„์ •๋Ÿ‰์ ์ธ? Like ์ทจํ–ฅ - ๋‚˜๋ˆ„๋Š” ๊ธฐ์ค€์ด ์ •ํ•ด์ง„ ๊ฒŒ ์—†์Œ)
@ ๋ฉ์–ด๋ฆฌ ๋งŒ๋“ค๊ธฐ, ๋ˆ„๊ฐ€ ๋น„์Šทํ•˜๋‹ค

๊ฐ•ํ™” ํ•™์Šต - ๋ง ๊ทธ๋Œ€๋กœ

Clustering Algorithm
ํด๋Ÿฌ์Šคํ„ฐ(๋ฉ์–ด๋ฆฌ), ๊ตฐ์ง‘ํ™” โ†’ ๋ถ„๋ฅ˜, ํด๋ž˜์Šคํ™”(๋ ˆ์ด๋ธ”)
์œ ์‚ฌ์„ฑ์— ์˜ํ•ด ๋ฉ์–ด๋ฆฌ๋ฅผ ๋‚˜๋ˆˆ๋‹ค
@ Like ํ•˜์–€๊ฑด ์ข…์ด์š”, ๊ฒ€์€๊ฑด ๊ธ€์”จ๋‹ค

์‚ฌ๋žŒ์ด ๋ญ”๊ฐ€ ๋ฐฐ์šธ ๋–„ ์ด๋ฏธ ์•Œ๊ณ  ์žˆ๋Š” ๊ฒƒ๊ณผ ๋น„์Šทํ•œ ๊ฒƒ์„ ์ฐพ์•„ ์—ฐ๊ด€์‹œํ‚ค๊ณ (๋ฉ์–ด๋ฆฌ),
๋งŒ์•ฝ ๊ทธ๊ฒŒ ์—†๋‹ค๋ฉด ์ดํ•ด๋ฅผ ์œ„ํ•œ ์ƒˆ๋กœ์šด ์ƒ๊ฐ(๋ฉ์–ด๋ฆฌ)์„ ๋งŒ๋“ ๋‹ค
์—์„œ ๋ชจํ‹ฐ๋ธŒ๋ฅผ ์–ป์€

ART1
โ†’ Feature Vector : ๋ญ๊ฐ€ ์–ด๋–ป๋‹ค ํ•˜๋Š” ํŠน์ง• ๋ฐ์ดํ„ฐ (ํ…Œ์ด๋ธ”)
โ†’ Feature Vector์˜ 1, 0์˜ ๊ฐœ์ˆ˜๊ฐ€ ๋น„์Šทํ•ด์•ผ ๋น„์Šทํ•œ ๋ฐ์ดํ„ฐ

@ U ์ค‘๊ฐ„๊ณ ์‚ฌ ์ถœ์ œ : ์ ์‘ํ˜• ๊ณต๋ช… ์ด๋ก ์— ๋Œ€ํ•œ ํด๋Ÿฌ์Šคํ„ฐ๋ง ๊ฒฐ๊ณผ๋ฅผ ๋ณด๊ณ , ํŠน์ • ์š”์†Œ(i.e. ๊ณ ๊ฐ)์—๊ฒŒ ํŠน์ • ์š”์†Œ(i.e. ๋ฌผ๊ฑด)๋ฅผ ์ถ”์ฒœํ•˜๋Š” ๊ณผ์ •์„ ์„ค๋ช…ํ•˜์‹œ์˜ค.

๊ฐ™์€ ๋ถ„๋ฅ˜์˜ ์š”์†Œ๋“ค๋ผ๋ฆฌ ๋ฐ์ดํ„ฐ Vector๋ฅผ ํ•ฉ (Sum Vector)
ํ•ด๋‹น ๋ถ„๋ฅ˜์˜ ์š”์†Œ๋“ค๋งˆ๋‹ค Sum Vector์—์„œ ๊ฐ€์žฅ ํฐ ์ˆ˜ ์ˆœ์„œ๋Œ€๋กœ ์—†๋Š” ์š”์†Œ๋ฅผ ์ถ”์ฒœ

๐Ÿ’ซ ๊ณผ์ •


  1. Create Initial Prototype Vector
  2. For each Example Vector, Continue
  3. Example Close to Prototype?
    • Passes Vigilance Test?
    • More Prototypes?
  4. Place Example in current prototype vector

Create Initial Prototype Vector
โ†’ ์ž„์˜์˜ ์š”์†Œ ์„ ํƒ (์ฒซ ๋ฒˆ์งธ๋“  ๋žœ๋ค์ด๋“ )
โ†’ P0 = E0

For each Example Vector
โ†’ Close to Prototype?

ฮฒ - ๊ทธ๋ƒฅ 1.0 (์ผ๋‹จ) ๋ชฐ๋ผ๋„ ๋œ๋‹ค
d - ์ „์ฒด ๋ฌผ๊ฑด์˜ ๊ฐœ์ˆ˜
E - ์‚ฐ ๋ฌผ๊ฑด

โ†’ Proximity Test - ์œ ์‚ฌ๋„ ํ…Œ์ŠคํŠธ
PโˆฉE (1์— ๋Œ€ํ•ด์„œ๋งŒ) / P ์ „์ฒด๋ฌผ๊ฑด + ฮฒ > E ์‚ฐ๋ฌผ๊ฑด(E 1์˜์ˆ˜) / E ์ „์ฒด๋ฌผ๊ฑด + ฮฒ
@ PDF 8p Eq1 3/4 > 4/8 (์˜คํƒ€)

โ†’ Vigilance Test? (๋ฉ์–ด๋ฆฌ๋กœ ๋ฌถ์„ ์ง€, ํ•œ ๋ฒˆ ๋” ํ‰๊ฐ€)
PโˆฉE / E ์‚ฐ๋ฌผ๊ฑด(E 1์˜์ˆ˜) < p (Vigilance Parameter)

true?

Place Example in Current Prototype Vector (๋งˆํ‚น? ๋ผ๋ฒจ๋ง? ๋ฉ์–ด๋ฆฌ?)

๋‚จ์€ ๊ฒƒ๋“ค์— ๋Œ€ํ•ด ์ƒˆ๋กœ์šด ํ”„๋กœํ† ํƒ€์ž…์„ ๋งŒ๋“ค์–ด ๋ฐ˜๋ณต

P = PโˆฉE
1110110
1110010
โ†’ 1110010

๋ฉ์–ด๋ฆฌ์— ํฌ๊ฒŒ ์˜๋ฏธ ์—†๋Š” ๋ฐ์ดํ„ฐ๋ฅผ ์ œ๊ฑฐ
(๊ต์žฌ 3.4 ๋ฐ‘์— Finally ๋ถ€ํ„ฐ ๋‚˜์˜ค๋Š” ๋‚ด์šฉ)

Using ART1 for Personalization(Recommend System)
Sum Vector๋ฅผ ์ด์šฉํ•˜์—ฌ

๐Ÿ’ซ K-means Algorithm


K-means Algorithm
๋ฉ์–ด๋ฆฌ๊ฐ€ K๊ฐœ ์žˆ๋‹ค๊ณ  ๋ชป๋ฐ•์•„๋‘๊ณ  ๋ถ„๋ฅ˜

๋จผ์ € K๋ฅผ ์ •ํ•˜๊ณ  โ†’ (์ด ๋ฐ์ดํ„ฐ์—๋Š” K๊ฐœ์˜ ๋ฉ์–ด๋ฆฌ๊ฐ€ ์žˆ๋‹ค๊ณ  ๊ฐ€์ •)
โ†’ (K๋ฅผ ์–ด๋–ป๊ฒŒ ์ •ํ•˜๋ƒ๋Š” ๋‹ค๋ฅธ ๋…ผ์ œ)
โ†’ (๋น„์ง€๋„ํ•™์Šต ์•Œ๊ณ ๋ฆฌ๋“ฌ์ด์ง€๋งŒ, ๋‹ต์ด ์ •ํ•ด์ ธ ์žˆ๋Š” ๊ฒƒ์ฒ˜๋Ÿผ - K)

  • Loop ~
    1. K๊ฐœ์˜ ์ž„์˜์˜ ์ ๋“ค์„ ๊ธฐ์ค€์œผ๋กœ, ๊ฐ€๊นŒ์šด ๊ฒƒ๋“ค์„ ๋ชจ์•„ K๊ฐœ์˜ ๋ฉ์–ด๋ฆฌ๋กœ ๋งŒ๋“ฆ
    2. ์ดํ›„ ๊ฐ ๋ฉ์–ด๋ฆฌ์˜ ์ค‘์‹ฌ์œผ๋กœ ๊ธฐ์กด K๊ฐœ์˜ ์ž„์˜์˜ ์ ๋“ค์„ ์žฌ์œ„์น˜
    3. ๋งŒ์•ฝ, ์ด์ „๊ณผ ๋‹ฌ๋ผ์ง„ ์ ์ด ์—†๋‹ค๋ฉด? ๋ถ„๋ฅ˜ ์™„๋ฃŒ End

์‹ค์ œ๋กœ๋Š” ์ ์ด ์•„๋‹ˆ๋ผ ํ…Œ์ด๋ธ”
3์ฐจ์› ์ด์ƒ์œผ๋กœ ๋„˜์–ด๊ฐ€๋ฉด ์ดํ•ดํ•˜๊ธฐ ํž˜๋“ฆ
๋ชป ์ฐพ์„ ์ˆ˜๋„ ์žˆ์Œ

์ด ๊ธฐ์‚ฌ๋Š” ์ €์ž‘๊ถŒ์ž์˜ CC BY 4.0 ๋ผ์ด์„ผ์Šค๋ฅผ ๋”ฐ๋ฆ…๋‹ˆ๋‹ค.