You can use these configuration templates to use with your wordpress and drupal web apps running on Azure to get started. You can modify this as per your needs. To learn more about Varnish 4.0 VCL documentation click here
For Drupal , check out this article to learn about drupal specific configuration along with varnish server