PRCoords
People's Rectified Coordinates (PRCoords) is a cross-language implementation of "public secret" Chinese coordinate obfuscation methods including GCJ-02 and BD-09, along with general deobfuscation methods previously established in ChinaMapShift, eviltransform, and geoChina. (Referring to the process of replacing straight lines with wavy ones as a "transform" is euphemism overdone.)
For a background on China's geographic obfuscation, see Restrictions on geographic data in China and 中华人民共和国测绘限制 on Wikipedia.
Languages
- JavaScript (
npm install prcoords
)- Web demo: https://artoria2e5.github.io/PRCoords/demo
- Now with AMD support and faux
__esModule
interop for Babel and TypeScript!
- Python (
pip install prcoords
) - (Obj-)C/C++ (C ABI)
- Makefile with
install
- Makefile with
- Ruby
- Swift
- C#
- Haskell (GCJ only; data structure incomplete)
- need to move googollee/eviltransform#54 here sometime.
- Java
- Matlab/Octave
- too lazy to split the files. also expand "caijun"
- PGSQL
- Typed Racket
- is it done?
(should I split them into submodules?)
For languages not yet supported, we recommend you to check for eviltransform (MIT) or geoChina (GPLv3, R) instead.
API
PRCoord's APIs operate on, and returns, dedicated structures for coordinates. In API names, we generally refer to WGS-84 as wgs
, GCJ-02 as gcj
, and BD-09 (lat-lon) as bd
.
Inverse functions
The obfuscations generally have these properties to maintain basic usefulness:
obfs(coord)
is sort of close tocoord
.obfs(a) - obfs(b)
is usually close toa - b
. (The closera
andb
are to each other, the better it works.)
In general two approaches of inverting the "forward" obfuscations, or working from
obfs(coord)
to coord
, are implemented:
- Run it backwards:
obfs(coord)
is never too far fromcoord
, so just useobfs(obfs(coord)) - obfs(coord)
to estimateobfs(coord) - coord
. - Iterate a bit: Get a rough
guess
somehow, and just use property 2 to estimate the remaining error asobfs(guess) - obfs(coord)
and correct theguess
.
You can read on the demo page about how well these methods work from the ΔRoundtrip
entry. Unless you are doing archival work, you generally don't have to iterate.
The "in China" sanity check
Typically PRCoords is only supposed to be ran on obfuscated input data, which are primarily Chinese coordinates. For this reason, initial implementations include this very very rough sanity check that spans a rectangular region on a mercator-projected map. This check can be overridden by passing a boolean value, or may be not at all implemented in certain languages if I am not in the right mood for doing silly things.
There is an "insane" sanity check intended to approximate the range of Google
and Baidu's distortion, intended for use by IITC:
js/insane_is_in_china.js
.
It is basically a ray-casting polygon check with 70 vertices. You, as the
caller, should still be responsible for telling whether a point is part of the
gov-screwed Chinese data.
FAQ
Why another wheel?
- Public Domain
- Clean API based on pairs of coordinates
- Need to find a place for this sarcastic name
Can the systems be described as WKT or proj-strings?
Not directly as a datum, because in both representations a datum is either "sane" (no non-linearity in 3D, Helmert possible) or a big table of grids.
It should be possible to describe the two CS with a PROJECTION
entry as
a PROJCS
. Since a PROJCS
cannot be nested in another, the BD
transformation must be described using WGS84 and a fuzed GCJ-BD projection.
The situation is similar with Baidu "Meractor".
Speculative WKT/PROJ4
PROJCS["Baidu 2009, Pseudo-Mercator",
GEOGCS["WGS 84",
DATUM["WGS_1984",
SPHEROID["WGS 84",6378137,298.257223563,
AUTHORITY["EPSG","7030"]],
AUTHORITY["EPSG","6326"]],
PRIMEM["Greenwich",0,
AUTHORITY["EPSG","8901"]],
UNIT["degree",0.0174532925199433,
AUTHORITY["EPSG","9122"]],
AUTHORITY["EPSG","4326"]],
PROJECTION["CN_Obfs_Baidu_2009_Mercator"],
AXIS["x",east],
AXIS["y",north],
UNIT["metre",1,
AUTHORITY["EPSG","9001"]],
EXTENSION["PROJ4","+proj=baidumerc +units=m +nadgrids=@null +wktext +no_defs"],
AUTHORITY["EPSG","888002"]]
PROJCS["Chinese BSM 2002, Pseudo-Ellipsoidal",
GEOGCS["WGS 84", AUTHORITY["EPSG","4326"]],
PROJECTION["CN_Obfs_GCJ_2002_Ellipsoidal"],
AXIS["longitude",east],
AXIS["latitude",north],
UNIT["degree",0.0174532925199433,
AUTHORITY["EPSG","9122"]],
EXTENSION["PROJ4","+proj=gcjlonglat +units=deg +nadgrids=@null +wktext +no_defs"],
AUTHORITY["EPSG","888000"]]
The good people at proj4js has made their stuff very easy to extend. Here is an example.
Should I use fast fp math?
Yes. Nobody knows what the original looks like anyways, so what's wrong with letting the compiler recombine a bit more? You can't be more off than the one-meter random error (in "EMQ") anyways.
Or tinker with 32-bit floats and fixed-point numbers. Or try approximation tools like Sollya or MC++. Really, just search on the Internet for "<language> Taylor Chebyshev Model". You only need less than 1e-6 error on a not-very-large slice of the Earth anyways.
I threw TaylorModels.jl at GCJ-02, and got decent results out of it. Still too lazy to put it in code though. Check out approx/approx.ipynb.
Physical PRCoords
You can print out a minimal copy of PRCoords with this PDF file. I am working on some better options in issue #2. A fairly simple tote bag with an older version of the PDF is available from Teespring.
Feel free to print and sell t-shirts with the PDF file! It is put in the Public Domain, so you don't have to pay me for that. You can always fund my subversive activities on Patreon though.
License
Unless otherwise mentioned, all files in this package, including this README file, are dual-licensed under:
GPL is only included for fun here.
Sources
- Algorithm.Coords.Converter from EMQ (GitHub mirror) is probably the GCJ leak. It is a JSP project "for demonstrating GIS systems", probably done by some government contractor.
- There is some randomness in the GCJ deltas on both axes: one
sin
invocation and one LCG. Each add a maximum of 1 meter of error.
- There is some randomness in the GCJ deltas on both axes: one
- on4wp7 (2013) is the earliest rationalized GCJ (forward) implementation. No randomness is attempted.
- ChinaMapShift (2014) figured out the quick iterative inverse for GCJ. I learned about it via geoChina first and generalized it here.
- BD-09 is not very well sourced, but pycoordtrans (2014) seems to have it.
See also
- eviltransform is among the most popular cross-language soltions to the problem. It borrows its name directly from EvilTransform.cs, an early refactored version of a raw-flesh Java implementation found in "emq", some sort of government contractor GIS demo project.
- geoChina by caijun is a clear, concise implementation written in R. It features the iterative method from ChinaMapShift.
- I am planning on moving some of the comments on the algorithm found in my initial JavaScript implementation to the GitHub Wiki. I don't think anyone is going to be interested in copying comments on these idiocy when translating my implementation to other languages.
- If you are doing a translation, consider only using the comments from the PDF.
- Ishisashi's writeup on this subject. They wrote a super enhanced version of the demo too.
Oh, and finally, here is an official news report on that particular [bleep] who came up with GCJ-02.