This project provides support for using fs2 for streaming JSON parsing and decoding with circe, a Scala library for encoding and decoding JSON to Scala types.
Circe-fs2 provides different pipes to parse your streams of JSONs depending on whether your stream is:
- a \n-separated stream of JSON values or value stream:
{ "repo": "circe-fs2", "stars": 14 }
{ "repo": "circe-config", "stars": 5 }- or a JSON array:
[
{ "repo": "circe-fs2", "stars": 14 },
{ "repo": "circe-config", "stars": 5 }
]The appropriate pipe for the job also depends on your input stream value type (i.e. String, Byte
or Segment[Byte]).
The following table sums up every pipe available as a function of the input stream value type as well as the JSON structure:
| String | Byte | Segment[Byte] | |
|---|---|---|---|
| Value stream | stringStreamParser |
byteStreamParser |
byteStreamParserS |
| Array | stringArrayParser |
byteArrayParser |
byteArrayParserS |
As an example, let's say we have a stream of strings representing a JSON array, we'll
pick the stringArrayParser pipe which converts a stream of String to a stream of Json, Circe's
representation of JSONs:
import io.circe.fs2._
val stringStream: Stream[IO, String] = ...
val parsedStream: Stream[IO, Json] = stringStream.through(stringArrayParser)Circe-fs2 also comes with a decoder pipe which, given a Decoder[A], produces a
Stream[F[_], Json] => Stream[F[_], A] pipe.
For example, using Circe's fully automatic derivation:
import io.circe.generic.auto._
case class Foo(a: Int, b: String)
val parsedStream: Stream[IO, Json] = ...
val decodedStream: Stream[IO, Foo] = parsedStream.through(decoder[IO, Foo])All circe projects support the Typelevel code of conduct and we want all of their channels (Gitter, GitHub, etc.) to be welcoming environments for everyone.
Please see the circe contributors' guide for details on how to submit a pull request.
circe-fs2 is licensed under the Apache License, Version 2.0 (the "License"); you may not use this software except in compliance with the License.
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.