Powered by ML, Azure TTS & Unreal Engine 5
This projects was recently featured in PAGE Magazine 02/2024. Thank You! See: https://page-online.de/shop/page-02-2024/
ARIS: Echoes is a demo game that showcases the use of AI-powered NPCs in a story-driven experience. Discover a lost planet with your robot companion ARIS and work together to escape back to earth. It showcases a custom built NPC framework for Unreal Engine built with C++ and Machine Learning. It enables natural dialogue and an NPC that is controlled by an AI model, which in turn can dynamically perceive game events and perform actions in-game. This early version uses vector embeddings for context and heavy string manipulation to enable communication between the model and the engine. The goal is to convert this into a simple cpp port that can run locally and easily be embedded into other games without a large performance overhead.
Watch a live demo here or for the german version here
Or a long-form exploratory walkthrough here
Or view the project Documentation.
Note: The demo application voice features are currently optimized for german. English version is coming soon.
![ARIS AI NPC](https://private-user-images.githubusercontent.com/48035650/250584480-1198c1ef-9eff-49fe-aa26-74c73b82877e.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQyNzczMTcsIm5iZiI6MTcyNDI3NzAxNywicGF0aCI6Ii80ODAzNTY1MC8yNTA1ODQ0ODAtMTE5OGMxZWYtOWVmZi00OWZlLWFhMjYtNzRjNzNiODI4NzdlLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MjElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODIxVDIxNTAxN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWFmYWJiNDZlMzE2Yjk0ZWNlYjc0MjNiZDVlODdiYmVjYjQ2ODQxZjczYTMxMDg4ZjdmZjBiYzZlNjVmODQ1NzkmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.euyAh35d8sco0FhvU_wVLbiyhKFhgi2thb4hlCaGH1g)
![Jarvis IV (Dunes)](https://private-user-images.githubusercontent.com/48035650/250585438-9d35fb25-7dbc-47ae-a06e-3b9f267da507.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQyNzczMTcsIm5iZiI6MTcyNDI3NzAxNywicGF0aCI6Ii80ODAzNTY1MC8yNTA1ODU0MzgtOWQzNWZiMjUtN2RiYy00N2FlLWEwNmUtM2I5ZjI2N2RhNTA3LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MjElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODIxVDIxNTAxN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWRlYjk1ODAwZGFkZWYxNjg1OWY5OWYxOGQ3YzQ2YzlhZWUxNmMyMmEzNDFkMDBlOWMzODI0MTFhNzNjYTExMGImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.Lrd5GWqcptZQd0cL_8D6reLcCV4Fx5mLUFZ4q7dKG2U)
![Jarvis IV (Glacier)](https://private-user-images.githubusercontent.com/48035650/250585687-bc03d57a-ff0d-49f0-929d-cbe5905574d4.jpeg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQyNzczMTcsIm5iZiI6MTcyNDI3NzAxNywicGF0aCI6Ii80ODAzNTY1MC8yNTA1ODU2ODctYmMwM2Q1N2EtZmYwZC00OWYwLTkyOWQtY2JlNTkwNTU3NGQ0LmpwZWc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwODIxJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDgyMVQyMTUwMTdaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT02YzI3MjZlOGQ1Y2E1YjU2MjkwYTgwYTgyN2ZkNzYzM2Q1MmZiYzAwNDNhMGNmOGM5YTk3ODNlMGU3ODE1ODg2JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.pkeYyEYhHBGYAlS1TNRLI8RM7Ko55SW6t7Z8NUuZBtk)
ARIS: Echoes is a demo game that presents an exciting glimpse into the future of gaming, where AI-powered Non-Player Characters (NPCs) enhance the player's story-driven experience. In this adventure, you embark on a journey to a lost planet, accompanied by your trusty robot companion, ARIS. Together, you must collaborate and overcome challenges to find a way back to Earth. Discover the history of the barren Jarvis IV system and encounter various AIs that challenge the way you typically play games.
Features:
GPT-4-Powered NPCs: Immerse yourself in a dynamic world where NPCs utilize advanced AI algorithms to interact with the player and adapt their behavior based on the context of the game.
Engaging Storyline: Dive into a captivating narrative filled with mystery and discovery as you explore the secrets of a forgotten planet that has been directly tied to the AI capabilities from the start of development.
Cooperative Gameplay: Work alongside ARIS, your robot companion in novel ways, leveraging their unique abilities to solve puzzles, overcome obstacles and explore the world together with you in natural language.
Immersive Environments: Unreal Engine 5-powered Nanite & Lumen Environments. Experience stunning visuals and atmospheric sound design that transport you to a rich and detailed game world.
This is more of a tech-demo than a complete game that was created for university. However it should offer a glimpse into the capabilities of AI-driven storytelling and some future aspects of the gaming and entertainment industry. It was developed to be a more intricate demo of the technology, than usually seen in current Tech-demos and Trailers.
Download the latest release and try it out for yourself!
Upcoming:
- Localization (English)
- VR-Mode
- Steam-Demo
Instructions:
Start the ARIS.exe file to begin.
Controls
• Interact: Press the "E" key to interact with objects in the game world.
• Talk: Press the "F" key to speak with other characters in the game. Speak into your microphone. These characters are AI-controlled, and you can ask them any kind of questions.
• Other commands: Cutscenes can be skipped with the "Q" key. Additional commands will be displayed in the game. Follow the on-screen instructions to perform specific actions.
Minimum Requirements
• Peripheral devices: Microphone for voice functions is essential.
• Graphics card: Nvidia GeForce GTX 1070 with 8 GB dedicated VRAM.
• Processor: Intel Core i5 or equivalent AMD Ryzen processor.
• Memory: 8 GB RAM (recommended: 16 GB RAM for optimal performance).
• Storage: At least 2 GB of free space on the hard drive or SSD.
• Operating System: Windows 10 (64-bit).
• DirectX: Version 11 or higher.
• Internet connection: Essential for AI features.
Notes
• In the settings, you can adjust the graphics quality, volume, microphone used, and the AI model employed.