Faraday Retry

The Retry middleware automatically retries requests that fail due to intermittent client or server errors (such as network hiccups). By default, it retries 2 times and handles only timeout exceptions. It can be configured with an arbitrary number of retries, a list of exceptions to handle, a retry interval, a percentage of randomness to add to the retry interval, and a backoff factor. The middleware can also handle the Retry-After header automatically when configured with the right status codes (see below for an example).

Installation

Add this line to your application's Gemfile:

gem 'faraday-retry'

And then execute:

bundle install

Or install it yourself as:

gem install faraday-retry

Usage

This example will result in a first interval that is random between 0.05 and 0.075 and a second interval that is random between 0.1 and 0.125.

require 'faraday'
require 'faraday/retry'

retry_options = {
  max: 2,
  interval: 0.05,
  interval_randomness: 0.5,
  backoff_factor: 2
}

conn = Faraday.new(...) do |f|
  f.request :retry, retry_options
  #...
end

conn.get('/')

Control when the middleware will retry requests

By default, the Retry middleware will only retry idempotent methods and the most common network-related exceptions. You can change this behaviour by providing the right option when adding the middleware to your connection.

Specify which methods will be retried

You can provide a methods option with a list of HTTP methods. This will replace the default list of HTTP methods: delete, get, head, options, put.

retry_options = {
  methods: %i[get post]
}

Specify which exceptions should trigger a retry

You can provide an exceptions option with a list of exceptions that will replace the default exceptions: Errno::ETIMEDOUT, Timeout::Error, Faraday::TimeoutError, Faraday::Error::RetriableResponse. This can be particularly useful when combined with the RaiseError middleware.

retry_options = {
  exceptions: [Faraday::ResourceNotFound, Faraday::UnauthorizedError]
}

If you want to inherit default exceptions, do it this way.

retry_options = {
  exceptions: Faraday::Retry::Middleware::DEFAULT_EXCEPTIONS + [Faraday::ResourceNotFound, Faraday::UnauthorizedError]
}

Specify on which response statuses to retry

By default the Retry middleware will only retry the request if one of the expected exceptions arise. However, you can specify a list of HTTP statuses you'd like to be retried. When you do so, the middleware will check the response status code and will retry the request if included in the list.

retry_options = {
  retry_statuses: [401, 409]
}

Automatically handle the `Retry-After` and `RateLimit-Reset` headers

Some APIs, like the Slack API, will inform you when you reach their API limits by replying with a response status code of 429 and a response header of Retry-After containing a time in seconds. You should then only retry querying after the amount of time provided by the Retry-After header, otherwise you won't get a response. Other APIs communicate their rate limits via the RateLimit-xxx headers where RateLimit-Reset behaves similarly to the Retry-After.

You can automatically handle both headers and have Faraday pause and retry for the right amount of time by including the 429 status code in the retry statuses list:

retry_options = {
  retry_statuses: [429]
}

If you are working with an API which does not comply with the Rate Limit RFC you can specify custom headers to be used for retry and reset, as well as a block to parse the headers:

retry_options = {
  retry_statuses: [429],
  rate_limit_retry_header: 'x-rate-limit-retry-after',
  rate_limit_reset_header: 'x-rate-limit-reset',
  header_parser_block: ->(value) { Time.at(value.to_i).utc - Time.now.utc }
}

Specify a custom retry logic

You can also specify a custom retry logic with the retry_if option. This option accepts a block that will receive the env object and the exception raised and should decide if the code should retry still the action or not independent of the retry count. This would be useful if the exception produced is non-recoverable or if the the HTTP method called is not idempotent.

NOTE: this option will only be used for methods that are not included in the methods option. If you want this to apply to all HTTP methods, pass methods: [] as an additional option.

# Retries the request if response contains { success: false }
retry_options = {
  retry_if: -> (env, _exc) { env.body[:success] == 'false' }
}

Call a block on every retry

You can specify a proc object through the retry_block option that will be called before every retry, before There are many different applications for this feature, spacing from instrumentation to monitoring.

The block is passed keyword arguments with contextual information: Request environment, middleware options, current number of retries, exception, and amount of time we will wait before retrying. (retry_block is called before the wait time happens)

For example, you might want to keep track of the response statuses:

response_statuses = []
retry_options = {
  retry_block: -> (env:, options:, retry_count:, exception:, will_retry_in:) { response_statuses << env.status }
}

Development

After checking out the repo, run bin/setup to install dependencies.

Then, run bin/test to run the tests.

To install this gem onto your local machine, run rake build.

Releasing a new version

To release a new version, make a commit with a message such as "Bumped to 0.0.2", and change the Unreleased heading in CHANGELOG.md to a heading like "0.0.2 (2022-01-01)", and then use GitHub Releases to author a release. A GitHub Actions workflow then publishes a new gem to RubyGems.org.

Contributing

Bug reports and pull requests are welcome on GitHub.

License

The gem is available as open source under the terms of the MIT License.

jimeh/faraday-retry