Java Dns Cache Manipulator(DCM
) contains 2 subprojects:
DCM
Library
A tiny 0-dependency thread-safe lib for setting/viewing dns programmatically without touching host file, make unit/integration test portable. SupportJava 8/11/17
, supportIPv6
.DCM
Tool
A tiny tool for setting/viewing dns of running JVM processes.
From
DCM 1.7+
upgrade toJava 8
.
If you needJava 6
support, use version1.6.x
- Java Dns Cache Manipulator(
DCM
) Library - Java Dns Cache Manipulator Tool
- Set/reset a DNS cache entry (won't lookup DNS afterwards)
- set a single
DNS record
- or batch setting through a
Properties
file
- set a single
- View DNS cache entry content (positive dns cache and/or negative dns cache)
- Remove a DNS cache entry (i.e. lookup DNS again)
- Clear the DNS Cache (re-Lookup DNS for all domain names)
- Set/View DNS cache time of
JVM
(positive dns cache and negative dns cache)
- The domain name is hard-coded in some libraries, and have to modify the
host file
binding to do the test(e.g. unit test, integration test). Turn out:- Generally, developers do not have the permission to modify the
host file
on the continuous integration machine, which leads to the continuous integration fail.- In fact, because of this, the demand for this library was born. 😣 🔫
- Unit testing requires each developer to do some host binding on the development machine, which increases configuration operations and is tedious and repetitive.
- Generally, developers do not have the permission to modify the
- Some functions require domain names instead of IPs as input parameters, such as HTTP gateways or web applications with domain name restrictions.
- In this case, you need a domain name to connect to the IP of the test machine; Or need use a test domain name that does not exist yet, but you do not want to or can not configure the DNS.
- In the performance test,
- want to skip DNS lookup through network (bypass the DNS resolution consumption), so that stress testing pays more attention to server response, and stress testing can fully reflect the performance of the core implementation code.
- DNS cache can be set dynamically instead of inflexible ways such as modifying host files and http links.
- A
JVM
process can have a set of domain name binding without affecting other JVM, be able to run stress testing with multi-scenario and multi-domain binding.
- When opening the
SecurityManager
inJava
(such as a web application in the Web containerTomcat
),Java
's DNS will not be expired by default. If the IP bound to the domain name changes, you can reset the DNS through this library.- Set the running JVM DNS Cache through the
DCM
Tool. application need not containDCM
Library dependency (i.e.Jar
). - Or call the method of
DCM
Library through the execution entry, such as remote call orjvm-ssh-groovy-shell
. The application need containDCM
Library dependency (ieJar
).
- Set the running JVM DNS Cache through the
Set/View DNS through the class DnsCacheManipulator
.
DnsCacheManipulator.setDnsCache("hello.com", "192.168.1.1");
// support IPv6
DnsCacheManipulator.setDnsCache("world.com", "1234:5678:0:0:0:0:0:200e");
// The above settings take effect globally,
// and then all the domain name resolution logic in Java will be the IP set above.
// Let's use a simple method to get the IP of the domain name to demonstrate:
String ip = InetAddress.getByName("hello.com").getHostAddress();
// ip = "192.168.1.1"
String ipv6 = InetAddress.getByName("world.com").getHostAddress();
// ipv6 = "1234:5678:0:0:0:0:0:200e"
// set multiple IPs
DnsCacheManipulator.setDnsCache("hello-world.com", "192.168.2.1", "192.168.2.2");
String ipHw = InetAddress.getByName("hello-world.com").getHostAddress();
// ipHw = 192.168.2.1, read the first IP
InetAddress[] allIps = InetAddress.getAllByName("hello-world.com");
// Read the multiple IP setting
// Set the expiration time, unit is milliseconds
DnsCacheManipulator.setDnsCache(3600 * 1000, "hello-hell.com", "192.168.1.1", "192.168.1.2");
In testing, it is expected that the domain name binding will be written in a configuration file.
The usage is as follows:
provide the file dns-cache.properties
on ClassPath:
# Configuration format:
# <host> = <ip>
hello-world.com=192.168.1.1
# Support setting multiple IPs, separated by commas
foo.com=192.168.1.2,192.168.1.3
# Support IPv6
bar.com=1234:5678:0:0:0:0:0:200e
Then complete the batch setting with the following code:
DnsCacheManipulator.loadDnsCacheConfig();
NOTE:
The default configuration file name is
dns-cache.properties
. and the configuration file name used can be modified through the-D
optiondcm.config.filename
of theJVM
:-Ddcm.config.filename=my-dns-cache.properties
.
// or load the batch setting from the specified file name explicitly
DnsCacheManipulator.loadDnsCacheConfig("my-dns-cache.properties");
In unit testing, it is often written in the setUp
method of the test class, such as:
@BeforeClass
public static void beforeClass() throws Exception {
DnsCacheManipulator.loadDnsCacheConfig();
}
// Get a dns cache entry by host
DnsCacheEntry entry = DnsCacheManipulator.getDnsCache();
// get whole dns cache info DnsCache including cache and negative cache.
DnsCache dnsCache = DnsCacheManipulator.getWholeDnsCache();
// get positive dns cache entries
// same as DnsCacheManipulator.getWholeDnsCache().getCache()
List<DnsCacheEntry> positiveEntries = DnsCacheManipulator.getWholeDnsCache();
// get dns negative cache entries
// same as DnsCacheManipulator.getWholeDnsCache().getNegativeCache()
List<DnsCacheEntry> positiveEntries = DnsCacheManipulator.getWholeDnsCache();
aka. relookup DNS later.
DnsCacheManipulator.removeDnsCache("bing.com");
DnsCacheManipulator.clearDnsCache();
// View the cache time, in seconds. -1 means cache forever, 0 means never cache
int cachePolicy = DnsCacheManipulator.getDnsCachePolicy();
// Set the cache time
DnsCacheManipulator.setDnsCachePolicy(2);
// View the cache time of missed entries(negative entries)
DnsCacheManipulator.getDnsNegativeCachePolicy()
// Set the cache time of missed entries
DnsCacheManipulator.setDnsNegativeCachePolicy(0);
With the release of Java 16 the access control of the new Jigsaw module system is starting to be enforced by the JVM. If you use DCM
under Java 16+, add below Java options:
--add-opens java.base/java.net=ALL-UNNAMED
--add-opens java.base/sun.net=ALL-UNNAMED
If you use maven
(e.g. running test), add below config:
<profiles>
<profile>
<id>add-java-open-options-for-jdk16+</id>
<activation>
<jdk>[16,)</jdk>
</activation>
<properties>
<argLine>
--add-opens java.base/java.net=ALL-UNNAMED
--add-opens java.base/sun.net=ALL-UNNAMED
</argLine>
</properties>
</profile>
</profiles>
The domain name is not case-sensitive.
The domain name may be converted to lower case uniformly before entering the JVM
DNS Cache.
One of the causes is that the case of the domain name in the DNS query result will be different from the case of the entered domain name, if the entered domain name has uppercase letters.
- For the logic that has been resolved and saved the IP, setting the JVM DNS cache will not take effect! This can be resolved by re-creating the connection or the client.
For HttpClient
:
HttpClient client = new HttpClient();
GetMethod m1 = new GetMethod("https://bing.com");
client.executeMethod(m1);
String content = m1.getResponseBodyAsString();
// Set up DNS and bind to your own machine
DnsCacheManipulator.setDnsCache("bing.com", "192.168.1.1");
// Re-execute m1, still the old result
client.executeMethod(m1);
String content = m1.getResponseBodyAsString();
// Re-create GetMethod to get the results on your own machine
GetMethod m2 = new GetMethod("https://bing.com");
client.executeMethod(m2);
content = m2.getResponseBodyAsString();
See the documentation for the class DnsCacheManipulator
.
Java API document: http://alibaba.github.io/java-dns-cache-manipulator/apidocs
Maven
example:
<dependency>
<groupId>com.alibaba</groupId>
<artifactId>dns-cache-manipulator</artifactId>
<version>1.7.1</version>
</dependency>
You can view the latest version at search.maven.org.
- Article Source code analysis of java dns parsing cache /
java dns
解析缓存之源码解析 is very complete and have source code analysis, give noteworthy conclusions:- Open the SecurityManager in Java, the DNS cache will not be invalidated.
- Otherwise, the accessible DNS resolution will be cached for 30 seconds by default, and the inaccessible DNS resolution will be cached for 10 seconds by default.
- Regarding the jvm dns cache (domain name cache time) / 关于
jvm dns cache
(域名缓存时间), the conclusion of "what strategy is used to return IP for multiple A records" is given:- During the validity period of the cache, the obtained IP is always the first A records in the cache, and there is no such strategy as round-robin.
- After the cache is invalidated, perform DNS resolution again. Because the order of the A records returned by the domain name resolution will change (visible in the dig google.com test), the order of the data in the cache has also changed, and the obtained IP will also change.
- Modify the content of DNS cache in JDK 1.6 through JAVA reflection / 通过
JAVA
反射修改JDK 1.6
当中DNS
缓存内容, give the scene of setting DNS cache in performance test. - The dns cache problem of java InetAddress / java InetAddress 的 dns cache 问题 indicates that
HttpClient
needs to recreate theGetMethod
/PostMethod
object to make the DNS setting take effect.
- Set/reset a DNS cache entry
- View DNS cache entry content
- Remove a DNS Cache
- Clear DNS Cache
- Set/View DNS cache time of
JVM
download the file
dcm-x.y.z.tar.gz
.
After decompression, run dcm
in the bin
directory.
$ dcm -h
usage: Options
-h,--help show help
-p,--pid <arg> java process id to attach
# For the Java process whose process ID is 12345
# set the domain name foo.com IP to 1.1.1.1
$ dcm -p 12345 set foo.com 1.1.1.1
# For the Java process whose process ID is 12345
# set the domain name bar.com IP to 2.2.2.2 3.3.3.3 (multiple IPs are possible)
$ dcm -p 12345 set bar.com 2.2.2.2 3.3.3.3
View single entry:
# For the Java process whose process ID is 12345,
# obtain the DNS entry information of the domain name bing.com
$ dcm -p 12345 get bing.com
bing.com 220.181.57.217,180.149.132.47,123.125.114.144 2015-06-05T18:56:09.635+0800
# The output format:
# "the domain name" "IP list (there may be multiple IPs)" "expiration time"
View all DNS cache:
$ dcm -p 12345 list
Dns cache:
bar.com 2.2.2.2,3.3.3.3 292278994-08-17T15:12:55.807+0800
bing.com 220.181.57.217,180.149.132.47,123.125.114.144 2015-06-05T19:00:30.514+0800
foo.com 1.1.1.1 292278994-08-17T15:12:55.807+0800
Dns negative cache:
# Output entries containing Cache and Negative Cache.
# The entry is indented 4 spaces.
# In the above example, Negative Cache is empty.
# Remove a DNS
$ dcm -p 12345 rm bing.com
# Clear all DNS Cache
$ dcm -p 12345 clear
# View the cache time, in seconds.
# -1 means cache forever, 0 means no cache
$ dcm -p 12345 getPolicy
30
# Set cache time
$ dcm --pid 12345 setPolicy 5
# View the cache time of missed entries, in seconds.
# -1 means cache forever, 0 means no cache
$ dcm -p 12345 getNegativePolicy
10
# Set the cache time of missed entries
$ dcm -p 12345 setNegativePolicy 0