relyonai

Python Runtime Inline AI Calls

🤖 AI language extension.
📉 Reduces code size.
🐍 Can use python runtime objects.
💿 Caches calls, so it's fast on re-runing.
✅ Fixes mistakes internallly.
🎁 Saves runtime context for reusing.
⭐️ Uses Few-Shot and COT under the hood.

Warning
See Reflections.

Usage

pip install relyonai
export OPENAI_API_KEY=...

from relyonai import ai
f = ai('get print hello world func')
f()

from relyonai import config
config.model = 'gpt-4'
config.clear_cache()

See tests for more.

Reflections

Although the idea is working to some extent, it remains largely impractical for the time being. It falls short in a few crucial areas:

Reliability and Consistency: The code that's being generated is not consistently accurate, with minor prompt modifications often leading to significant changes.
Controllability: GPT-3.5, which was the primary model for the development of 0.1, practically ignores system messages and often fails to follow few-shot examples, even for simple calls.
Privacy and Security: This conserns could be largely mitigated by clever prompting and potentially runtime sandboxing (like patching Python's open call or something similar).

GPT-4 is expected to be a major leap over all axes with usable clever system messages and better Few-Shot/COT, but it needs to become publicly accessible, approximately 5x cheaper and roughly 2x faster to be practical for this task.

0.2 Plans

Note
this is a rough draft

License

MIT

stasbel/relyonai

relyonai

Usage

Reflections

0.2 Plans

License