GoGo Protobuf looking for new ownership

Question

GoGo Protobuf looking for new ownership

awalterschulze opened this issue 5 years ago · 62 comments

I write to you on behalf of the GoGo Protobuf project, which has long been supported by a small group of dedicated developers taking time out of their lives to keep the project up to date and add new features, to the benefit of all users. Unfortunately, the personal circumstances of the maintainers have changed and we are no longer able to keep up with the issues and feature requests that naturally crop up for a popular open source project.

In particular, the recent golang/protobuf release 1.4.x (AKA APIv2: https://blog.golang.org/protobuf-apiv2), has created a big chunk of work required to be compatible with the new world of Go protobufs. While longer term this work will likely make gogo/protobuf much more compatible with the rest of the ecosystem, there is currently no one to take on this piece of work, and users are living in uncertainty around the future of the project.

We are therefore reaching out to industry users such as yourself to ask for help with maintaining the project. Without external help, it is likely that the GoGo Protobuf project will be discontinued. We know there are many organisations out there that use the project, so we're hoping that one or more of them would step up to take on this maintenance.

Please let us know if you are a user that can take on (co)ownership of this project.
It is as simple as commenting on this issue.

Sincerely,

@awalterschulze and @johanbrandhorst

From Walter:

I want to thank @jmarais and @donaldgraham for doing a great job stepping up to take on maintenance of GoGo Protobuf over the past 2 years.
I want to also thank @johanbrandhorst for developing and maintaining the GRPC interoperability.
I am very lucky and proud to call you all my friends.

Anagirotti commented a year ago

[ ]

👍2

Answer 1 · 2020-05-20T13:50:51.000Z

I would really hate to see this project die and would love to see parity with the new Proto APIv2. I would like to help contribute as much as I can. Do you think before the existing core contributors move on, can create a milestone or set of issues needing to be completed to be compatible with the latest v2 updates?

Answer 2 · 2020-05-20T14:12:33.000Z

I share the same sentiment. I would like to contribute and help organize gogoproto. That being said I am unfamiliar with the inner workings of gogoproto and I am a junior developer, but I am willing to learn and work with others to help this project live on.

Answer 3 · 2020-05-20T14:48:36.000Z

The first task is to identity the current incompatibilities with APIv2. Just a quick look at the issue tracker gives me:

#686
#678

There will probably be more, but it would be good to first get an idea of the exact shortcomings and necessary fixes. Assuming no bigger org steps up to take over, I think the short term goal is 1.4.x compatibility. If ownership can be transferred, there could be talk of a GoGo protobuf APIv2.

Answer 4 · 2020-05-20T22:05:15.000Z

Would love to take part of this project
@johanbrandhorst, @awalterschulze

Answer 5 · 2020-05-21T00:10:07.000Z

Hello @awalterschulze (and other gogo protobuf maintainers), thanks for opening up this discussion!

Would you be able to give a bit more details on how would this new ownership would be ideally structured?

Are you trying to find a new home to step down as the leaders of this project?
Are you looking to share the responsibility with a new group of maintainers?
Would the current maintainers be interested in a sponsorship to spend some focus time on gogo protobuf?

Answer 6 · 2020-05-21T08:41:35.000Z

Thank you.
These are great questions.

Are you trying to find a new home to step down as the leaders of this project?

Yes and ideally a new home, where the employer(s) or team(s) acknowledges and gives those employee(s) at least some time to work on the project.

Are you looking to share the responsibility with a new group of maintainers?

No. All our circumstances have changed so much that this won't be possible.

Would the current maintainers be interested in a sponsorship to spend some focus time on gogo protobuf?

I know this is a No for me and Johan and highly probably a no for Donald and Jacques.

Answer 7 · 2020-05-23T14:15:47.000Z

We recently did some work to port a project from GoGo Protobuf to the v2 API. Aside from gogoproto.nullable (which we use quite a bit, in particular with WKTs), the blockers we identified were custom names, struct tags, and native well-known types.

Requests for these features are tracked here on the Go Protobuf repo:

go_name: golang/protobuf#555
Struct tags: golang/protobuf#52
Standard Go types for well-known types: golang/protobuf#414

The v2 reflection API might make implementing some of these easier than forking the project. If these features are important to you, I’d recommend weighing in on these issues.

Answer 8 · 2020-06-03T09:01:26.000Z

Reporter of #686 here. At work we're heavily reliant on gogo/protobuf for ergonomic gRPC APIs, and rewriting every enum and re-inventing a struct tag injector is not an option.

I tried to do some of the porting at that time, but it seems much of the machinery that the original maintainers used to track upstream is not public stuff (say, committed in this repo). On top of that it's generally hard to justify general open-source maintenance work when the department is under-staffed. We're watching this situation though, and I have just enough experience in compilers to review and debug code. If anyone steps up and decides to do the grunt work, I could probably spend a few weekends to help.

Answer 9 · 2020-06-04T13:55:34.000Z

Does someone want to compile a list of issues in a comment here & then we can work on creating a milestone to work towards?

It seems there are a few people that have stated interest in keeping this repo alive. And work towards upgrading this repo.

Answer 10 · 2020-06-04T14:48:16.000Z

Feel free to start with the ones linked already. We don't need a milestone, I don't think?

Answer 11 · 2020-06-04T16:45:39.000Z

#695 Is another one

Answer 12 · 2020-06-06T15:01:24.000Z

where is the best place to ask questions in regards to updating? is there a chat somewhere I can join or is here the best....?

Answer 13 · 2020-06-06T15:16:05.000Z

The #protobuf channel on Gophers slack is probably a good place to start.

Answer 14 · 2020-06-06T16:13:17.000Z

I see many teams moving out of gogo. I considered the same for our project and run simple benchmark test to compared v1, v2, and gogo: https://github.com/alexshtin/proto-bench.

The results show that gogo is still ~2 times faster and v2 is actually slower than v1. We decided to stay on gogo. Unfortunately, we don't have resources to provide much help now but we might have them later.

Answer 15 · 2020-06-10T15:51:36.000Z

I would love to see this project maintained and would offer to contribute as I can. We currently are maintaining a fork https://github.com/regen-network/protobuf for use in https://github.com/cosmos/cosmos-sdk. I have a few open PR's that we are using actively on our fork: #657, #658, and #426

A few of my colleagues working on Cosmos/Tendermint. @alexanderbez and @marbar3778 have chimed in here as well so we may have some limited bandwidth, but we likely wouldn't want to be the only org responsible for maintenance and upgrading to v2. If anyone else is interested let us know.

It seems from the comments that there are parallel efforts to upgrade the v2 implementation to support some of the gogo proto features, yet that implementation is slower. Either way, it would be great to see the community align on a path forward rather than splintering - either upgrading gogo to v2 or porting gogo features to v2.

Answer 16 · 2020-06-10T16:01:43.000Z

Struct tags: golang/protobuf#52

@ydnar after years of wishfully waiting for struct tags, it seems now that golang/protobuf has decided not to implement this feature :(

Answer 17 · 2020-06-10T16:48:44.000Z

Struct tags: golang/protobuf#52

@ydnar after years of wishfully waiting for struct tags, it seems now that golang/protobuf has decided not to implement this feature :(

Agreed, I’m disappointed. We kind of stirred the pot with golang/protobuf#1142, but I’m glad that the Go protobuf maintainers have at least clarified their position.

We’ve prototyped an internal tool that wraps protoc-gen-go, intercepting the CodeGeneratorRequest and CodeGeneratorResponse, parses the Go source using the ast and types packages, and modifies the output before serialization.

I’ll share what we have when we have something working for (at least) our use cases.

Answer 18 · 2020-06-10T21:23:35.000Z

@ydnar -- I think https://github.com/srikrsna/protoc-gen-gotag does exactly what you have described

Answer 19 · 2020-06-14T05:52:00.000Z

I’ll share what we have when we have something working for (at least) our use cases.

Progress update: we now have a working protoc-gen-go-patch tool that does what I described above. It uses the v2 protogen package and go/ast / go/types for most of the heavy lifting, and doesn’t require forking protoc-gen-go. I hope to extract it as a separate public package sometime next week.

Currently supported options: go_tags, go_name, go_message_name, go_enum_name, and go_value_name. TODOs include gRPC, oneof support, and a patch/gogo package for gogoproto.* options that alias to the above.

More interesting features like GoGo’s WKTs like time.Time are more complicated, but it’s a fun start.

Answer 20 · 2020-06-14T07:10:35.000Z

@ydnar this sounds very promising.
The TODO list as you describe should be highest priority.
I hope that customtype is not necessary, but do you think casttype would be possible?

gogoproto.* options that alias to the above.

This sounds like an interesting migration story.

Answer 21 · 2020-06-14T07:15:55.000Z

@ydnar could you give an example of how users specify the tags, names, etc?

Is it also using the protobuf extensions, like https://github.com/srikrsna/protoc-gen-gotag and gogoprotobuf or do you have a new method?

Answer 22 · 2020-06-14T13:49:34.000Z

@ydnar could you give an example of how users specify the tags, names, etc?

Is it also using the protobuf extensions, like https://github.com/srikrsna/protoc-gen-gotag and gogoprotobuf or do you have a new method?

Exactly. It uses extensions without a package name to allow proto files to specify short option names. Here’s an example:

https://gist.github.com/ydnar/fbb49f92412ecd6bb895b36e90c9a707

Answer 23 · 2020-06-14T14:02:54.000Z

I hope that customtype is not necessary, but do you think casttype would be possible?

Good question. Modifying a basic type in an AST should be straightforward. More than that will require surgery. The nullable option will require changes: golang/protobuf#1142

Edit: @awalterschulze do you have any data on how often and how casttype is used, and if users specify a fully-qualified package + type selector, or just a type?

Answer 24 · 2020-06-15T05:16:31.000Z

Progress:

Support oneof fields.
Rename enum values when enum is renamed.
Rename oneof fields and synthesized types/methods when parent message is renamed.
Support renamed identifiers from imported packages.
Rename identifiers in doc comments in Go AST.
Support gRPC.
Add optional patch/gogo package to support GoGo Protobuf options like gogoproto.custom_name as an alias for go_name.

Answer 25 · 2020-06-15T15:01:27.000Z

Edit: @awalterschulze do you have any data on how often and how casttype is used, and if users specify a fully-qualified package + type selector, or just a type?

I used to use it this way -> https://github.com/moul/depviz/blob/cc631458b3262ff3e121fdd15b49ff42c57777bc/api/dvmodel.proto#L41

Result -> https://github.com/moul/depviz/blob/cc631458b3262ff3e121fdd15b49ff42c57777bc/internal/dvmodel/dvmodel.pb.go#L222

Answer 26 · 2020-06-15T16:03:30.000Z

@moul

I don't have data, but I expect it would mostly be qualified as in your example.

Answer 27 · 2020-06-18T00:56:12.000Z

I pushed an early build of protoc-gen-go-patch here: https://github.com/alta/protopatch

YMMV, but it works for us. TODO: tests, GoGo shim, more features.

Answer 28 · 2020-06-19T23:25:52.000Z

Update: https://github.com/alta/protopatch has a new—arguably less simple, but easier to extend—API:

go.message.options — message options, which modify the generated Go struct for a message.
go.field.options (also aliased to go.options) — message field options, which modify Go struct fields and getter methods.
go.oneof.options — oneof field options, which modify struct fields, interface types, and wrapper types.
go.enum.options — enum options, which modify Go enum types and values.
go.value.options — enum value options, which modify Go const values.

Custom Names

import "patch/go.proto";
import "patch/go/message.proto";
import "patch/go/field.proto";
import "patch/go/enum.proto";
import "patch/go/value.proto";

message OldName {
	option (go.message.options) = {name: 'NewName'};
	int id = 1 [(go.field.options) = {name: 'ID'}];
}

enum Errors {
	option (go.enum.options) = {name: 'ProtocolErrors'};
	INVALID = 1 [(go.value.options) = {name: 'ErrInvalid'}];
	NOT_FOUND = 2 [(go.value.options) = {name: 'ErrNotFound'}];
	TOO_FUN = 3 [(go.value.options) = {name: 'ErrTooFun'}];
}

Struct Tags

message ToDo {
	int32 id = 1 (go.field.options) = {name: 'ID', tags: '`xml:"id,attr"`'}]
	string description = 2 (go.field.options) = {tags: '`xml:"desc"`'}]
}

Tests!
Shimming it for equivalent GoGo extensions should be straightforward.
Adding more complex features, such as re-typing fields or casttype is more complex.

Answer 29 · 2020-06-26T15:01:52.000Z

@ydnar I gave a try to your https://github.com/alta/protopatch repo, it works very well and I like the syntax, the usage etc

fyi, for now, the only thing that prevents me to switch real projects is the lack of (gogoproto.stdtime) = true, but the project is very promising 👍

Answer 30 · 2020-06-26T20:46:38.000Z

I have an initial spike on a GoGo compatibility shim, with support for one extension (gogoproto.customname). Having gone through this exercise, I’m not sure the juice is worth the squeeze. A full GoGo shim has the potential to be larger than the rest of the package. Is it worth it to maintain, when a single find & replace could potentially suffice? I’m not sure.

alta/protopatch#8

I’m curious—which GoGo extensions do folks value most? Which could you live without? Which are obsoleted or mitigated by APIv2?

Answer 31 · 2020-06-29T19:48:12.000Z

I’m curious—which GoGo extensions do folks value most? Which could you live without? Which are obsoleted or mitigated by APIv2?

$ for repo in pathwar.land berty.tech/berty berty.tech/yolo ultre.me/calcbiz moul.io/depviz github.com/moul/engine; do echo $repo; cd ~/go/src/$repo; git grep gogoproto\\. | grep proto: | tr " " "\n" | grep gogoproto\\. | sed 's/.*(\(gogoproto\.[^)]*\))/\1/' | sort | uniq -c; echo; done
pathwar.land
     89 gogoproto.customname
      1 gogoproto.goproto_enum_prefix_all
      6 gogoproto.marshaler_all
    151 gogoproto.moretags
     53 gogoproto.nullable
      6 gogoproto.sizer_all
     53 gogoproto.stdtime
      6 gogoproto.unmarshaler_all

berty.tech/berty
     93 gogoproto.customname
      3 gogoproto.goproto_enum_prefix_all
      2 gogoproto.jsontag
      3 gogoproto.marshaler_all
      3 gogoproto.sizer_all
      3 gogoproto.unmarshaler_all

berty.tech/yolo
     45 gogoproto.customname
      1 gogoproto.marshaler_all
     12 gogoproto.moretags
     19 gogoproto.nullable
      1 gogoproto.sizer_all
     19 gogoproto.stdtime
      1 gogoproto.unmarshaler_all

ultre.me/calcbiz
     11 gogoproto.customname
      4 gogoproto.marshaler_all
      4 gogoproto.sizer_all
      4 gogoproto.unmarshaler_all

moul.io/depviz
     16 gogoproto.casttype
      9 gogoproto.customname
      1 gogoproto.equal_all
      1 gogoproto.goproto_getters_all
      1 gogoproto.goproto_registration
      2 gogoproto.marshaler_all
     49 gogoproto.moretags
      9 gogoproto.nullable
      1 gogoproto.populate_all
      2 gogoproto.sizer_all
      8 gogoproto.stdtime
      2 gogoproto.unmarshaler_all

github.com/moul/engine
      7 gogoproto.casttype
      4 gogoproto.customname
      5 gogoproto.enumdecl
    251 gogoproto.enumvalue_customname
      5 gogoproto.goproto_enum_prefix
      5 gogoproto.goproto_enum_stringer
     20 gogoproto.goproto_getters
      1 gogoproto.goproto_getters_all
      3 gogoproto.goproto_stringer
      2 gogoproto.marshaler_all
     14 gogoproto.nullable
      6 gogoproto.protosizer_all
      6 gogoproto.sizer_all
     10 gogoproto.stdduration
      3 gogoproto.stdtime
     20 gogoproto.typedecl
      2 gogoproto.unmarshaler_all

summary:

$ for repo in pathwar.land berty.tech/berty berty.tech/yolo ultre.me/calcbiz moul.io/depviz github.com/moul/engine; do cd ~/go/src/$repo; git grep gogoproto\\. | grep proto: | tr " " "\n" | grep gogoproto\\. | sed 's/.*(\(gogoproto\.[^)]*\))/\1/'; echo; done |  sort | uniq -c | sort -n -r
    251 gogoproto.enumvalue_customname
    251 gogoproto.customname
    212 gogoproto.moretags
     95 gogoproto.nullable
     83 gogoproto.stdtime
     23 gogoproto.casttype
     22 gogoproto.sizer_all
     20 gogoproto.typedecl
     20 gogoproto.goproto_getters
     18 gogoproto.unmarshaler_all
     18 gogoproto.marshaler_all
     10 gogoproto.stdduration
      6 gogoproto.protosizer_all
      6
      5 gogoproto.goproto_enum_stringer
      5 gogoproto.goproto_enum_prefix
      5 gogoproto.enumdecl
      4 gogoproto.goproto_enum_prefix_all
      3 gogoproto.goproto_stringer
      2 gogoproto.jsontag
      2 gogoproto.goproto_getters_all
      1 gogoproto.populate_all
      1 gogoproto.goproto_registration
      1 gogoproto.equal_all

I can't say if it's a good idea to be 100% compatible with gogoproto (I prefer new protopatch usage)

The most important missing ones for me are:

gogoproto.stdtime
gogoproto.nullable
gogoproto.casttype

And a very cool one too:

gogoproto.goproto_enum_prefix_all

Answer 32 · 2020-07-02T13:32:11.000Z

I can't say if it's a good idea to be 100% compatible with gogoproto (I prefer new protopatch usage)

Thanks!

The most important missing ones for me are:

gogoproto.stdtime

The new helper functions in latest release of protobuf-go enable converting to/from standard time and duration. They’re great.

gogoproto.nullable

Unlikely to happen unless the protobuf-go authors change an IsNil check on sub-messages: golang/protobuf#1142

gogoproto.casttype

I think this is possible with some work.

gogoproto.typedecl

Interesting. How do you use it?

And a very cool one too:

gogoproto.goproto_enum_prefix_all

How would you imagine this working with the protopatch API?

Answer 33 · 2020-07-05T11:39:23.000Z

gogoproto.stdtime

The new helper functions in the latest release of protobuf-go enable converting to/from standard time and duration. They’re great.

I really need a time.Time type and not helpers, because gorm (and probably a lot of other reflection-based libraries) doesn't understand that a struct of two fields is actually a timestamp; my current fallback is to use int64 Unix timestamps for DB models

no gogoproto.stdtime -> no proto.Timestamp and proto.Duration at all in some library combinations

gogoproto.typedecl

Interesting. How do you use it?

I'm not the author of the code, but you can look here:

https://github.com/bblfsh/bblfshd/blob/master/daemon/protocol/generated.proto

I just updated my previous command to remove it as the "most important missing things" section since I don't know if it's important :)

Answer 34 · 2020-08-03T20:32:22.000Z

@awalterschulze hello, sorry for mentioning – maybe pin this issue to be visible in issues list?

P.S. Many thanks for work on this project to you and all other maintainers.

Answer 35 · 2020-08-07T19:30:40.000Z

Good idea. It seems the issue is already pinned. I tried to repin it.

Answer 36 · 2020-08-12T18:13:58.000Z

@awalterschulze Sorry to hear your moving on! Thanks for the great project and good luck with your next venture. Gogo was a pleasure to use and really helped fix a lot of the usability problems with protobuf. I have always been impressed with how your maintainership moved forward on usability where the upstream did not.

Answer 37 · 2020-08-14T19:40:05.000Z

Thank you @stevvooe those are very kind words and much appreciated. You also helped this project a lot, first external contributor, where you added enumvalue_customname and enum_customname pushing the initiative for gogoprotobuf to generate golint compatible code. It was really great to work with you.

Answer 38 · 2020-08-20T22:23:10.000Z

Would it be possible to get a label/milestone tracking the work? I would love to pick up a bugfix here or there when possible, but sadly can't dedicate time to maintenance.

Thank you so much for your efforts maintaining this, gogoproto has been an incredible boon to the Protobuf and Go ecosystem.

Answer 39 · 2020-08-21T08:36:41.000Z

I've added an apiv2 label (https://github.com/gogo/protobuf/issues?q=is%3Aissue+is%3Aopen+label%3Aapiv2), if anyone is interested in starting to look through the issues. Fair warning, the issues will run quite deep.

Answer 40 · 2020-11-28T01:07:27.000Z

@awalterschulze
Hi,
I can start maintain gogo-pb, what should I do first?
I'm maintainer of json-iterator, go-toml, beego etc. now and lots of libraries in my company dependence on gogo-pb .
I think I can maintain gogo-pb in long term.

Answer 41 · 2020-11-28T07:39:09.000Z

@AllenX2018 Hello! 😅
I'm glad to hear you want give a hand, but I think you are likely misunderstanding between maintain and contribute.
It's not a problem, because the most important thing is that you want to become a maintainer. So, the first thing that is you want to fix all of the issues by PRs and whatever make it works.

Answer 42 · 2020-12-02T08:02:25.000Z

Hi @AllenX2018 thank you for offering.
Just to make sure we are on the same page.
You are offering to take over maintenance of gogoprotobuf in the long term?
In other words, take over leadership of the project.
Or are you offering to contribute, by addressing some issues?

If you are offering to take over and lead, what would be your plan?
Do you have the backing of your company, because this will probably require more work, than just out of office hours?
Or do you have a partner or two in this, so you can share the load?
What do you think would be most important to fix first?
etc.

If you are offering to contribute by fixing some issues.
Then unfortunately this is not what this issue is about.
We need someone to review other peoples' contributions (pull requests), reply to issues opened, create a plan to handle proto2, etc. This is not a small amount of work.

I think it is important that the new owner(s) have their company rely on this project and back the person(s) maintaining it.

I might be wrong, this is my first time handing over such a big project, so I am also learning.

Answer 43 · 2020-12-26T16:16:23.000Z

I took the time to re-implement the top 3 extensions needed by our projects, in the form of protobuf-gogogo (pardon the name). Note this is very preliminary work without testing infrastructure set up, don't use in (your) production yet.

The extensions implemented:

gogoproto.moretags
gogoproto.jsontag
gogoproto.enumvalue_customname

gogoproto.stdtime is unneeded with APIv2 IMO, because the Timestamp WKT has convenience methods that don't return err, the ergonomics was hugely improved.

Answer 44 · 2021-06-03T19:53:38.000Z

https://vitess.io/blog/2021-06-03-a-new-protobuf-generator-for-go/

Answer 45 · 2021-06-04T05:19:49.000Z

given the result vitess.io showed in this blob post, I would say gogoprotobuf has a good contender for a replacement.

Answer 46 · 2021-06-04T13:25:44.000Z

given the result vitess.io showed in this blog post, I would say gogoprotobuf has a good contender for a replacement.

Agreed, absolutely great job @vmg
Unfortunate to loose some features, but having them in gogoprotobuf added a huge maintenance burden that was unfortunately not sustainable. vtprotobuf has a sustainable maintenance path and very impressive speed improvement provided by memory pooling. I really enjoyed reading the well written post.

Answer 47 · 2021-06-07T09:09:12.000Z

Thank you! As pointed on the post, there are important Gogo features that we cannot support (most notably: non-nullable fields, which make a significant improvement in GC stress). In exchange, we do support ProtoBuf APIv2 and hopefully we're gonna have an easy time keeping the project up to date with the changes in upstream ProtoBuf. Please feel free to check out the new codegen and report bugs in our repository!

Answer 48 · 2021-06-07T10:05:20.000Z

@vmg

Maybe it is okay to not support nullable, given proto3?

It should be easy to add: gostring for debugging, populate for testing.
But this could also maybe be covered by goderive
https://github.com/awalterschulze/goderive/tree/master/example/plugin/gostring

I think the only hard feature, I would consider supporting is casttype.
How hard would that be with APIv2?

Answer 49 · 2021-06-07T20:30:12.000Z

@vmg
Thank you for a great post, and sharing the tool!
I have a question though

we cannot support

If community comes with MRs to add some missing pieces, would you consider adding them, or you only add what you can support, sorry?

Answer 50 · 2021-06-08T08:38:28.000Z

@tandr: we're always open to new features, but as the blog post explains, supporting a feature like optional nullable fields would require forking all of protoc-gen-go, which is something we don't want to do (even if somebody were to send a PR) because the long term maintenance cost is very high.

Answer 51 · 2021-06-08T21:50:50.000Z

@tandr: we're always open to new features, but as the blog post explains, supporting a feature like optional nullable fields would require forking all of protoc-gen-go, which is something we don't want to do (even if somebody were to send a PR) because the long term maintenance cost is very high.

Curious—why would you need to fork protoc-gen-go?

Answer 52 · 2021-06-11T10:36:35.000Z

@ydnar I can vouch that you would need to fork.
You need to change how the structs are generated in protoc-gen-go and you also need to change how the reflection works for those cases in the proto library. It is fun work to do, but very hard work to maintain, given your fork will probably not be a hard fork, but a soft fork, since you would probably want to incorporate updates from golang/protobuf.

Answer 53 · 2021-09-27T18:45:53.000Z

Howdy, everyone. We’ve added a few more features to protopatch in the last few weeks, like support for embedded structs (thanks @Adphi!) and optional.

His most recent PR (alta/protopatch#61) will add support for overriding the type of a generated message field, ala Gogo’s casttype option.

Answer 54 · 2021-09-27T19:43:43.000Z

Maybe I should also mention https://github.com/cosmos/cosmos-proto. We have implemented fast marshaling and fast proto reflection for the golang proto v2 API. There are a few additional features in the works for our use case similar to customtype that may or may not be desirable for other protobuf users (cosmos/cosmos-proto#2 and cosmos/cosmos-proto#5)

Answer 55 · 2022-04-07T13:34:04.000Z

For yet another alternative to GoGo protobuf, see https://github.com/CrowdStrike/csproto. This was developed by Crowdstrike to fill the performance gap left between GoGo and the official Go protobuf implementation. It can also be used to migrate from APIv1 to APIv2 over time:

The runtime-agnostic APIs do the work of calling the correct runtime based on which generator was used to emit the Go struct so you don't run into problem when, for example, you pass a struct generated by protoc-gen-gogo to proto.Unmarshal() from google.golang.org/protobuf/proto. csproto.Unmarshal() inspects the underlying type of the msg parameter and will call Gogo's proto.Unmarshal() instead.

CC @dylan-bourque, the author.

Answer 56 · 2022-10-24T14:36:41.000Z

gogoprotobuf is now officially deprecated, so I'll be closed this issue.

I gave a final farewell to the project at GopherCon UK 2022, which you can watch here:
https://twitter.com/awalterschulze/status/1584553056100057088

Thanks again for all the support and I am sorry for any inconvenience caused.

Answer 57 · 2022-10-24T17:39:02.000Z

If anyone is looking for a code-gen solution for Protobuf, I highly recommend vtprotobuf: https://github.com/planetscale/vtprotobuf

Answer 58 · 2022-10-24T18:48:22.000Z

Related ... I created https://github.com/CrowdStrike/csproto if you need to support the V1 API (since vtprotobuf is API v2 only).

Answer 59 · 2022-10-25T06:29:59.000Z

What a pity! I just want to use it in my project,
Thanks for you all great job

Answer 60 · 2022-10-25T17:25:36.000Z

@cod-soap, you "just want" but we really did (3 years ago) and it is very deep integrated in our project. Moreover, I used one of those 40 strategies and created a soft fork for soft forked project. Thank you, @awalterschulze for the great job and great presentation. I am not complaining, just saying.

Answer 61 · 2022-10-26T09:13:28.000Z

@alexshtin Happy to hear you enjoyed the video :)

A soft fork of a soft fork wow, that must have been really tough. I am really sorry you had to go through that.