/exd

Library for data handling on backend systems, based on Ecto for Elixir and Erlang.

Primary LanguageElixir

Exd

Main goals

  • handling data patterns in consistent way
  • consistent way to expose the models to CLI/API/WEB
  • integration with erlang

Exd - library based on ecto for productive boost in data handling for backend systems. There are some different goals, make it possible to quick bootstrap and migrate, allow configuration-based change of models ( customizing ) and implementing API in generic way.

If some of functionality ( like auto migration ) will be usefull generally in ecto, we are ready to move and contribute it to ecto.

For playing with database and try all examples, use ecto_it.

Development state

Very alpha, functional, some parts are still not working or not working properly.

Configurable model on start

There is model_add construct and a function, which allows on start to define the model and with 'plugins', how should the data see.

import Exd.Model

model Weather do # is for later at now
  schema "weather" do
    field :city
    field :temp_lo, :integer
    field :temp_hi, :integer
    field :prcp,    :float, default: 0.0
  end

  def test1, do: 1
end # compiles to Ecto model

model_add WindWeather, to: Weather do
  schema do
    field :wind, :float, default: 0.0
  end
  def test2, do: 2
end

After that it possible to generate the right model on start:

Exd.Model.compile(Weather, [WindWeather])
Exd.Model.compile(Weather, [])

This functionality may be changed in the future to an explicit composable model.

Export an API

It is possible to export your model in generic way to a consumer.

For example:

defmodule Weather.Api do
  @moduledoc "Weather API documentation"
  @name "Weather"
  @tech_name "weather"
  use Exd.Api, model: Weather, repo: EctoIt.Repo
  crud
end

Use precompiled API. (Note: to get example work, you need to compile model and API, because for a iex compilation, the documentation is not available)

MIX_ENV=test iex -S mix

Now you have many different methods, which is possible to introspect with apix.

iex> Apix.spec(Weather.Api, :methods)
["option", "insert", "put", "get", "delete"]

By using of Exd.Api you will be automatically get method option, which is possible to use to introspect yourself.

iex> Apix.apply(Weather.Api, "option", %{})

CLI

Now, you can generate CLI with:

mix exd.escript

Start named node:

$ MIX_ENV=test iex --sname test -S mix
iex> Application.ensure_all_started(:ecto_it)
iex> Ecto.Migration.Auto.migrate(EctoIt.Repo, Weather)
iex> :code.load_file(Weather.Api)

Now you can use CLI for accessing running node as:

./exd insert exd/weather city:Berlin temp_hi:32 temp_lo:20
./exd get exd/weather id:1

For more information, see './exd -h'. It is still work in progress, zmtp is not functional, as native formatter is not completly implemented, at the moment.

Data handling patterns

There are some patterns on handling data (like inheritance, for example comment can inherit a user picture for that case, if the user changes the own picture, this specific comment will show old picture), that need to have generic handlers. [WiP]

Expose ecto to erlang application

As the ecto interface is based heavily on macros, and not directly invokable in erlang, there should exists reach erlang API to allow to handle and manipulate Ecto model from erlang application. [WiP]

Model-driven development

For different APIs, there should be an adaptor, which allows to define the model API in consistent way. There are 2 examples at the moment:

  • json-rpc - all data manipulation should be consistent with different models and the code should be written only once. ( Exd.Plugin.Hello - build-in example).
  • CLI - see CLI section

Tests

To run tests, you need to pass environment which depends on the database. For example:

MIX_ENV=pg mix test

or

MIX_ENV=mysql mix test