Ashthetik/Polarity-

A FER, AFINN and Heart-Monitoring system to intergrate into NLP/LLM, Game Engines, and more, by detecting the player's heart rate and emotional state throught gameplay to create more reactive scenarios and NPCs

Polarity++

Important

This project is in ALPHA stages and IS NOT expected to work and may cause potential damage in extreme cases. Proceed at your own risk.

Description:

This project is a combination of facial emotion recognition (FER), sentiment analysis using the AFINN lexicon, and heart rate monitoring. The system will be integrated into NLP/LLM engine games and other applications to detect the player's emotional state and heart rate during gameplay. By incorporating these technologies, the system aims to create more reactive scenarios and NPCs to enhance the overall gaming experience.

Features:

• Facial Emotion Recognition (FER): Detects the player's emotions through facial expressions using computer vision algorithms.
• Sentiment Analysis (AFINN): Analyzes the player's textual inputs to determine their emotional state based on the AFINN lexicon.
• Heart Rate Monitoring: Tracks the player's heart rate during gameplay using a heart rate monitor device.
• Integration with NLP/LLM engine games: Allows developers to incorporate the system into their games to create more immersive and dynamic gaming experiences.

Installation: (PITA - You'll need to figure it out)

1. Clone the repository: git clone https://github.com/Ashthetik/Polarity-.git
2. [To be Continued]

Usage: (Planned)

1. [Coming Soon]

Authors And Contributors:

• Ashley (me@ashleyxir.tech)
• CallMeZombie (Zonbi-san)

Credits:

• Proaust for the base of the RPPG: Proaust/heartbeat
• Daniel Ruskin for the fundamental layout of the RNN: DanielRuskin1/simple-recurrent-neural-network
• Georgi Gerganov for Whisper.cpp: ggerganov/whisper.cpp

License:

This project is licensed under the MIT License - see the LICENSE file for details.