You can use this as a start point for managing a WordPress install with git.
In it's current state, all you need to do is clone this repo, git submodule update --init then in wp-config.php update your database settings, and your default theme.
See 'Install and manage WordPress with Git' for more details.