A handy lookup table of similar technology and services to help ex-googlers survive the real world :)
pull-requests very welcomed. Please do not list any confidential projects!
For a working example of (some) of these technologies integrated together, see:
https://github.com/google/startup-os
See also: System Design Primer, The Hadoop Ecosystem Table, Map AWS services to GCP products
Google Internal |
Google External |
Open Source |
SaaS |
Dremel |
bigquery |
Apache Drill, Presto, Spark(sort-of), |
AWS Athena, Redshift Spectrum |
Dremel UI |
|
Redash, Metabase |
|
Search (Mustang, Alexandria) |
|
Elasticsearch, Solr, Lucene |
algolia |
pubsub |
pubsub |
NATS.io, RabbitMQ, PubNub |
AWS SQS/SNS, AWS AppSync |
Flume (Java) |
Apache Beam |
Apache Crunch |
|
Google Internal |
Google External |
Real-World |
Assimilator |
|
Dominator |
Blaze |
Bazel |
Buck, Pants, please.build |
Oncall |
|
PagerDuty, OpsGenie, VictorOps |
varz/borgmon |
|
Datadog, Prometheus, librato, newrelic, skylight, scout, Scotty/tricorder, also this and this |
Exception/Error Tracking (??) |
|
Sentry.io, Raygun.io, Rollbar, Honeybadger, Airbrake, OverOps |
styleguides |
google styleguides |
PEP-8, HoundCI auto-style-reviewer |
blaze test / build / CI |
|
buildkite, CircleCI, travis, jenkins, gitlabCI |
continuous delivery / releasing |
|
Spinnaker, lambdaCD, screwdriver.cd, CodeShip, shipit-engine, GoCD, AWS CodeDeploy, Capistrano, Fabric, ConcourseCI |
borg / borgcfg / gcl |
|
AWS Cloudformation, Puppet, Chef, Salt, Ansible, Terraform, Jsonnet, kubecfg |
logging |
StackDriver |
logstash, fluentd, papertrail, cernan |
CodeSearch |
Zoekt |
Sourcegraph, OpenGrok |
Gerrit, Mondrian etc. |
Gerrit |
Reviewable |
cider |
|
Eclipse Che, Cloud9, gitpod.io |
buganizer |
|
JIRA, bugzilla, github issues |
ToTT |
Google Test Blog |
|
Google Internal |
Google External |
Real-World |
prodaccess |
|
Keymaster |
prod secrets/identity management |
|
knox, SPIFFE |
also check out xoogler.co, which organizes events, slack channels etc
disclaimer: I'm not affiliated with any of the technologies mentioned above.
disclaimer: I left Google a number of years ago so some of the naming might be dated