- Overview
- Prerequisites
- Installation
- Usage
- Why use sbt-json?
- Settings
- Examples
- Settings in depth
- Code generation features
- Tasks
- Troubleshooting
- Contributing
sbt-json is an sbt plugin that generates Scala case classes for easy, statically typed, and implicit access of JSON data e.g. from API responses.
The plugin makes it possible to access JSON documents in a statically typed way including auto-completion. It takes a sample JSON document as input (either from a file or a URL) and generates Scala types that can be used to read data with the same structure.
sbt-json integrates very well with the play-json library as it can also generate play-json formats for implicit conversion of a JsValue to its Scala representation. (see example)
sbt-json also works with circe for many JSON schemas as circe automatically derives the necessary type classes for the generated types. (see example)
Supporting the generation of implicit encoders and decoders for different JSON libraries other than play-json is planned for future versions.
0.13.5 <= sbt version
Install the plugin according to the sbt documentation.
addSbtPlugin("com.github.battermann" % "sbt-json" % "0.5.0")
Edit the build.sbt file to enable the plugin and to generate case class sources whenever the compile task is executed:
enablePlugins(SbtJsonPlugin)
If you want to use play-json e.g. add:
libraryDependencies += "com.typesafe.play" %% "play-json" % "2.6.0"
After a successful installation place one or more .json files containing sample JSON documents in the directory src/main/resources/json/.
By default only the case classes will be generated. To generate play-json formats, add jsonInterpreter := plainCaseClasses.withPlayJsonFormats to your build.sbt file and reload sbt.
On compile, case classes will be generated in target/scala-{version}/src_managed/compiled_json/jsonmodels/{name} where name will be the name of the corresponding .json file.
To use the generated models, import jsonmodels.{name}._ in your application code. You can now map a JSON document that has the same schema as the sample JSON document (e.g. from an API response) to the generated models. This can be done implicitly e.g. with circe or with play-json (see examples below).
sbt-json supports easy, statically typed and implicit access to JSON data with minimal overhead and minimal boiler-plate.
There are other online tools (e.g. http://json2caseclass.cleverapps.io or http://transform.now.sh/json-to-scala-case-class) that allow pasting a JSON string to generate Scala case classes which you can copy and paste back into your solution. But with sbt-json, once installed, you don't need an external tool. Moreover, the workflow of adding a new JSON schema involves less steps and the generated case classes do not need to be maintained.
Additionally sbt-json handles a lot of edge cases that will cause problems when using the available online tools. For example:
- Optional object fields will be recognized automatically for an array of a given objects
- Derived class names will be unique
- Scala reserved words will be avoided
Another advantage of sbt-json is the optional generation of play-json formats that otherwise you would have to write manually.
| name | default | description |
|---|---|---|
| jsonInterpreter | plainCaseClasses |
Combinator that specifies which interpreter to use. (plainCaseClasses can be combined with withPlayJsonFormats: plainCaseClasses.withPlayJsonFormats ) |
| jsValueFilter | allJsValues |
Combinator that specifies which JSON values should be in-/excluded for analyzation. (allJsValues can be combined with exceptEmptyArrays and exceptNullValues. Example: allJsValues.exceptEmptyArrays |
| jsonSourcesDirectory | src/main/resources/json |
Path containing the .json files to analyze. |
| jsonUrls | Nil |
List of urls that serve JSON data to be analyzed. |
| jsonOptionals | Nil |
Specify which fields should be optional, e.g. jsonOptionals := Seq(OptionalField("<package_name>", "<class_name>", "<field_name>")) |
| packageNameForJsonModels | jsonmodels |
Package name for the generated case classes. |
If you want to analyze JSON data form https://www.bing.com/HPImageArchive.aspx?format=js&idx=0&n=1&mkt=en-US and ignore empty arrays, add the following lines to the build.sbt file:
jsonInterpreter := plainCaseClasses.withPlayJsonFormats
jsonUrls += "https://www.bing.com/HPImageArchive.aspx?format=js&idx=0&n=1&mkt=en-US"
jsValueFilter := allJsValues.exceptEmptyArrays
Then use play-json to read the JSON data:
import play.api.libs.json.Json
import jsonmodels.hpimagearchive._
val json = Source.fromURL("https://www.bing.com/HPImageArchive.aspx?format=js&idx=0&n=1&mkt=en-US").mkString
val imageArchive = Json.parse(json).as[HPImageArchive]
println(imageArchive.images.head.url)
sbt-json also works with circe for many JSON schemas as circe automatically derives the necessary type classes for the generated types.
In the buld.sbt add the circe dependencies:
val circeVersion = "0.8.0"
libraryDependencies ++= Seq(
"io.circe" %% "circe-core",
"io.circe" %% "circe-generic",
"io.circe" %% "circe-parser"
).map(_ % circeVersion)
Now add a file or URL with the JSON sample, e.g.:
jsonUrls += "https://api.coindesk.com/v1/bpi/currentprice.json"
Use circe to decode the JSON data:
import io.circe.generic.auto._
import io.circe.parser._
import jsonmodels.currentprice._
val url = "https://api.coindesk.com/v1/bpi/currentprice.json"
val rawJson = scala.io.Source.fromURL(url).mkString
val currentPriceOrError = decode[Currentprice](rawJson)
val output = currentPriceOrError fold (
err => err.getMessage,
currentPrice => {
val info = currentPrice.bpi.EUR.description
val priceInEuro = currentPrice.bpi.EUR.rate_float
val date = currentPrice.time.updated
s"Current Bitcoin price ($info): $priceInEuro (timestamp: $date)"
}
)
println(output)
With the jsonInterpreter setting additional generation features can be configured.
Besides generating the case classes, we can specify to generate play-json formats for implicit conversion.
The interpreters can be set like this in the build.sbt file (which is the default):
jsonInterpreter := plainCaseClasses
or if play-json-formats should be generated:
jsonInterpreter := plainCaseClasses.withPlayJsonFormats
By default the code generation will fail if the JSON sample contains empty arrays or null values. This follows the fail fast paradigm because some type information might be missing.
To change this behavior you can set jsValueFilter to ignore empty arrays or null values. The type of this setting is type JsValueFilter = JsValue => Boolean and there are two combinators available as well as a convenient syntax (implicit classes).
Configure this setting to ignore empty arrays:
jsValueFilter := allJsValues.exceptEmptyArrays
Ignore null values:
jsValueFilter := allJsValues.exceptNullValues
Ignore empty arrays as well as null values:
jsValueFilter := allJsValues.exceptEmptyArrays.exceptNullValues
By default all files with a .json extension in the directory src/main/resources/json will be analyzed. To change the directory set jsonSourcesDirectory of type jva.io.File to the desired value, e.g.:
jsonSourcesDirectory := baseDirectory.value / "json"
jsonUrls is a sequence of strings that represent URLs that serve JSON documents to be analyzed. Add a new URL like this:
jsonUrls += "https://www.bing.com/HPImageArchive.aspx?format=js&idx=0&n=1&mkt=en-US"
If the JSON documents contain optional fields, they have to be explicitly marked as such. To do this, add a value of type OptionalField containing the package name, class name, and field name to the jsonOptionals setting.
Place a file fbpost.json containng a JSON document of a facebook post inside the json-sources directory:
{
"id":"339880699398622_241628669274112",
"created_time":"2012-06-19T07:51:06+0000",
"message":"great information for Linux fan ;-)",
"full_picture":"https:\/\/scontent.xx.fbcdn.net\/v\/t31.0-8\/s720x720\/177827_10151014484731203_401775304_o.jpg?oh=69db574b81ebe6bfe97a4077b6806775&oe=5A25DA17"
}
You can inspect the result of the code generation by running the sbt-json task printJsonModels:
[info] /** MACHINE-GENERATED CODE. DO NOT EDIT DIRECTLY */
[info] package jsonmodels.fbpost
[info]
[info] case class Fbpost(
[info] id: String,
[info] created_time: String,
[info] message: String,
[info] full_picture: String
[info] )
[info]
[info] object Fbpost {
[info] import play.api.libs.json.Json
[info]
[info] implicit val formatFbpost = Json.format[Fbpost]
[info] }
Here the type of the message field is String. However, some facebook posts do not contain a message field. Implicit decoding of a JSON document like this will fail:
{
"id":"339880699398622_371821532871205",
"created_time":"2012-06-19T07:57:54+0000",
"full_picture":"https:\/\/scontent.xx.fbcdn.net\/v\/t31.0-8\/s720x720\/469692_371821072871251_145095902_o.jpg?oh=8a1be9485002e2d25dbe396a8f1fe176&oe=5A2F45F8"
}
To fix this, the field has to be marked as optional. Add the following line to the build.sbt file:
jsonOptionals += OptionalField("fbpost", "Fbpost", "message")
Run reload in the sbt console and inspect the generated code again with printJsonModels. The message field is now of type Option[String]:
[info] /** MACHINE-GENERATED CODE. DO NOT EDIT DIRECTLY */
[info] package jsonmodels.fbpost
[info]
[info] case class Fbpost(
[info] id: String,
[info] created_time: String,
[info] message: Option[String],
[info] full_picture: String
[info] )
[info]
[info] object Fbpost {
[info] import play.api.libs.json.Json
[info]
[info] implicit val formatFbpost = Json.format[Fbpost]
[info] }
If the JSON objects of an array are not consistent, the generator will unify the type by making all fields optional that are not shared by all objects.
The fields message and full_picture of the generated case class will be optional for this sample JSON document:
{
"posts":{
"data":[
{
"id":"339880699398622_185311264930535",
"created_time":"2012-06-06T08:31:09+0000"
}
{
"id":"339880699398622_347136625339696",
"created_time":"2012-05-10T06:42:49+0000",
"message":"Functional Programming and Android Game Development, a Happy Couple"
},
{
"id":"339880699398622_403676613005660",
"created_time":"2012-05-09T21:24:31+0000",
"message":"an HTML5 version of the popular Cut the Rope game with 25 levels is now available online for free\nhttp:\/\/www.cuttherope.ie\/",
"full_picture":"https:\/\/external.xx.fbcdn.net\/safe_image.php?d=AQC2A2jO1N9RhI2g&url=http\u00253A\u00252F\u00252Fwww.cuttherope.ie\u00252Ffb.png&_nc_hash=AQClKYpmQtwavvP0"
}
],
"id":"339880699398622"
}
Generated case classes:
/** MACHINE-GENERATED CODE. DO NOT EDIT DIRECTLY */
package jsonmodels.facebook
case class Facebook(
posts: Posts,
id: String
)
case class Posts(
data: Seq[Data]
)
case class Data(
id: String,
created_time: String,
full_picture: Option[String],
message: Option[String]
)
The generator will search for equal class names which can not be defined within the same scope and append ascending numbers starting with 1.
Consider this JSON document:
{
"value1": {
"foo": { "value": 42 }
},
"value2": {
"foo": { "value": "some string" }
}
}
The fields of the objects value1 and value2 have the same name (foo) but different types. Therefore the generated class names will be Foo and Foo1:
case class Equalnames(
value1: Value1,
value2: Value2
)
case class Value1(
foo: Foo
)
case class Foo(
value: Double
)
case class Value2(
foo: Foo1
)
case class Foo1(
value: String
)
The generator tries to avoid Scala reserved words and type names by appending the suffix Model to a class name that is a potential candidate to clash. E.g. case class List() will become case class ListModel(), or case class MyClass(this: String) will become case class MyClass(`this`: String). (This feature is not yet fully tested and there is still no guaranty that there won't be any clashes.)
If an objects schema has the exact same structure as a schema that was found before, it will be substituted by that schema.
{
"geometry": {
"location": {
"lat": 37.42291810,
"lng": -122.08542120
},
"viewport": {
"northeast": {
"lat": 37.42426708029149,
"lng": -122.0840722197085
},
"southwest": {
"lat": 37.42156911970850,
"lng": -122.0867701802915
}
}
}
}
Note that there are no case classes Northeast and Southwest generated. Instead the type of the fields will be declared as Location:
case class Geo(
geometry: Geometry
)
case class Geometry(
location: Location,
viewport: Viewport
)
case class Location(
lat: Double,
lng: Double
)
case class Viewport(
northeast: Location,
southwest: Location
)
| name | description |
|---|---|
| printJsonModels | Prints the generated case classes to the console. |
| generateJsonModels | Creates source files containing the generates case classes. |
If the generated code is ignored by the compiler, in the Project tool window include the folder target/scala-{version}/src_managed by selecting Mark Directory as | Generated Source Root through the context menu, as described here.
Contributions are very welcome and highly appreciated. You can contribute by sending pull request, by reporting bugs and feature requests here, or by giving feedback and suggestions for improvement.