/FaaS-Soong

Serverless Computing Model ๊ฐœ๋ฐœ (Function-as-a-Service) ๐Ÿš€ KEDA(Kubernetes-Event-Driven-AutoScaling)์„ ํ™œ์šฉํ•œ Scale-to-Zero ๊ตฌํ˜„

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

๋ถ„์‚ฐ Edge Cloud ํ™˜๊ฒฝ์—์„œ
Event ๊ธฐ๋ฐ˜ Function-as-a-Service ๊ธฐ๋Šฅ ๊ฐœ๋ฐœ
license

๐Ÿ† 2021๋…„ NET CHALLENGE CAMP SEASON8 GOLD AWARD. ์ˆญ์‹ค๋Œ€ํ•™๊ต ํŒ€ ๋น ์ˆญ(FaaSoong)
https://www.youtube.com/watch?v=UieUycoFO5o

Summary

KEDA(Kubernetes-Event-Driven-AutoScaling)์„ ํ™œ์šฉํ•œ Scale-to-Zero ๊ตฌํ˜„.

ํ‰์ƒ์‹œ์— ๋™์ž‘ํ•˜์ง€ ์•Š๋Š” ์ƒํƒœ์—์„œ ์ด๋ฒคํŠธ ๋ฐœ์ƒ ๊ธฐ๋ฐ˜์œผ๋กœ ์„œ๋น„์Šค ์ƒ์„ฑ ๋ฐ Scale-Out ํ•˜๋Š” Serverless Computing Model์„ ๊ตฌํ˜„ํ•œ๋‹ค. Edge-Cloud ํ™˜๊ฒฝ์—์„œ Event ๊ธฐ๋ฐ˜์œผ๋กœ ๋™์ž‘ํ•˜๋Š” ์‘์šฉ ์˜ˆ๋กœ์„œ ํŠน์ • ์ƒํ™ฉ ๋ฐœ์ƒ ์‹œ(์˜ˆ: ๊ตํ†ต์‚ฌ๊ณ  ๋ฐœ์ƒ ๋“ฑ) CCTV๊ฐ€ ๋ณต์žกํ•œ ์ธ์‹๊ธฐ๋Šฅ์„ ํ•˜๋Š” ์™ธ๋ถ€ OpenService๋ฅผ ์ด์šฉํ•˜์—ฌ ํ•ด๋‹น ์‚ฌ๊ฑด์„ ์ฒ˜๋ฆฌํ•˜๋Š” ์—ฌ๋Ÿฌ ์„œ๋น„์Šค๋ฅผ ํ•„์š”ํ•œ ๊ณณ์— ์ œ๊ณตํ•˜๋Š” FaaS(Function as a Service) Model์„ ๊ตฌํ˜„ํ•œ๋‹ค.

Developers

์ˆญ์‹ค๋Œ€ํ•™๊ต ์ „์ž์ •๋ณด๊ณตํ•™๋ถ€

Scope

Point of Infrasturcture

  • Kubernetes๋ฅผ ํ™œ์šฉํ•œ Cluster ๊ตฌ์ถ•.
  • Cluster Monitoring์„ ์œ„ํ•ด Prometheus์™€ Grafana๋ฅผ ์„ค์น˜.
  • KEDA ๋ฐ RabbitMQ Server ์„ค์น˜.

Point of Service

  • ์‚ฌ๊ณ  ์ƒํ™ฉ์„ ๊ฐ์ง€ํ•˜๋Š” Deep Learning Model์„ FaaS๋กœ์จ ๋ฐฐํฌ.
  • ์ƒํ™ฉ ๊ฐ์ง€๋ฅผ ๋‹จ๊ณ„์ ์œผ๋กœ ๊ตฌํ˜„ํ•จ์œผ๋กœ์จ ์ž์› ํšจ์œจ์„ฑ์„ ๊ทน๋Œ€ํ™”.
  • OpenCV๋ฅผ ์ด์šฉํ•˜์—ฌ ์›€์ง์ž„์„ ๊ฐ์ง€ํ•˜๋Š” ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์„ ์›Œ์ปค ๋…ธ๋“œ์—์„œ ๋™์ž‘.
  • ์ด๋ฒคํŠธ ๊ธฐ๋ฐ˜์˜ ํ•จ์ˆ˜ํ˜• ์„œ๋น„์Šค ์ œ๊ณต.

Overall Architecture

Scenario

64mssl

GPU Resource Monitoring

64mrtb


For more, please check out doc/