google/stenographer

Any concerns/experience writing to a distributed file system, e.g., Ceph?

capveg opened this issue · 2 comments

capveg commented

Hi,

I'm looking at Stenographer and it looks great. I was wondering if anyone has any experience or if there are any obvious issues with writing to a large distributed disk, e.g., Ceph's RDB block storage.

Thanks in advance.

gconnell commented

No personal experience. Is Ceph over the network? If so, make sure you're
not sniffing the packets containing the data you're writing, or you'll
quickly peg your bandwidth. Otherwise, if it's a well-behaving block
device, not sure about throughput but the basic concept should work.

On Tue, Jul 5, 2016 at 11:34 PM, Rob Sherwood notifications@github.com
wrote:

Hi,

I'm looking at Stenographer and it looks great. I was wondering if anyone
has any experience or if there are any obvious issues with writing to a
large distributed disk, e.g., Ceph's RDB block storage.

Thanks in advance.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#142, or mute the thread
https://github.com/notifications/unsubscribe/ABJ9tkynEuMNAAK5duCTUeTEWwHkmrnnks5qSz56gaJpZM4JFxGn
.

capveg commented

Yes, Ceph is over the network, but generally you have dedicated interfaces for it so no need to be concerned about a network feedback loop.

I'm setting up some trials and will let you know what I find. Thanks for the response.

  • Rob
    .