matlab-deep-learning/llms-with-matlab

Adding Embedding functionality

Opened this issue · 0 comments

Currently Matlab access to Ollama only supports text generation, but not the embeddings.
However, adding this functionality should not be hard, here is a snippet:

url = 'http://localhost:11434/api/embeddings';
data = struct(...
        'model', 'llama3.1', ...
        'prompt', 'Llamas are members of the camelid family');
    
% Send the HTTP POST request
options = weboptions('MediaType', 'application/json');
response = webwrite(url, data, options)
disp(response.embedding)